* updated integration tests and guidance * fixed merge test * updated integration tests * fix: remove duplicate --dist loadfile flag from pytest-xdist config Only one --dist mode can be active at a time; the second value silently overrides the first. Keep --dist worksteal (dynamic load balancing) and remove the redundant --dist loadfile from all workflow files and pyproject.toml configs. Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com> * docs: add keep-in-sync notes for merge and integration test workflows Both python-merge-tests.yml and python-integration-tests.yml share the same parallel job structure. Added sync reminders in workflow file comments, the python-testing SKILL.md, and CODING_STANDARD.md. Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com> * refactor: remove RUN_INTEGRATION_TESTS flag Integration test gating now uses two mechanisms: - `@pytest.mark.integration` for test selection via `-m` filtering - `skip_if_*_disabled` for credential/service availability checks The RUN_INTEGRATION_TESTS env var was redundant since the marker handles selection and the skip decorators already check for actual credentials. Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com> * fix: sync missing env vars from merge-tests to integration-tests Add OPENAI_EMBEDDINGS_MODEL_ID and AZURE_OPENAI_EMBEDDING_DEPLOYMENT_NAME to python-integration-tests.yml to match python-merge-tests.yml. Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com> * fix: remove remaining RUN_INTEGRATION_TESTS from embedding tests and docs Missed test_openai_embedding_client.py and vector-stores README in the earlier cleanup. Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com> * set functions tests to 3.10 --------- Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Sample Integration Tests
Integration tests that validate the Durable Agent Framework samples by running them against a Durable Task Scheduler (DTS) instance.
Setup
1. Create .env file
Copy .env.example to .env and fill in your Azure credentials:
cp .env.example .env
Required variables:
AZURE_OPENAI_ENDPOINTAZURE_OPENAI_CHAT_DEPLOYMENT_NAMEAZURE_OPENAI_API_KEY(optional if using Azure CLI authentication)ENDPOINT(default: http://localhost:8080)TASKHUB(default: default)
Optional variables (for streaming tests):
REDIS_CONNECTION_STRING(default: redis://localhost:6379)REDIS_STREAM_TTL_MINUTES(default: 10)
2. Start required services
Durable Task Scheduler:
docker run -d --name dts-emulator -p 8080:8080 -p 8082:8082 mcr.microsoft.com/dts/dts-emulator:latest
- Port 8080: gRPC endpoint (used by tests)
- Port 8082: Web dashboard (optional, for monitoring)
Redis (for streaming tests):
docker run -d --name redis -p 6379:6379 redis:latest
- Port 6379: Redis server endpoint
Running Tests
The tests automatically start and stop worker processes for each sample.
Run all sample tests
uv run pytest packages/durabletask/tests/integration_tests -v
Run specific sample
uv run pytest packages/durabletask/tests/integration_tests/test_01_single_agent.py -v
Run with verbose output
uv run pytest packages/durabletask/tests/integration_tests -sv
How It Works
Each test file uses pytest markers to automatically configure and start the worker process:
pytestmark = [
pytest.mark.sample("03_single_agent_streaming"),
pytest.mark.integration_test,
pytest.mark.requires_azure_openai,
pytest.mark.requires_dts,
pytest.mark.requires_redis,
]
Troubleshooting
Tests are skipped:
Ensure the required environment variables (e.g., AZURE_OPENAI_ENDPOINT) are set in your .env file.
DTS connection failed:
Check that the DTS emulator container is running: docker ps | grep dts-emulator
Redis connection failed:
Check that Redis is running: docker ps | grep redis
Missing environment variables:
Ensure your .env file contains all required variables from .env.example.
Tests timeout: Check that Azure OpenAI credentials are valid and the service is accessible.
If you see "DTS emulator is not available":
- Ensure Docker container is running:
docker ps | grep dts-emulator - Check port 8080 is not in use by another process
- Restart the container if needed
Azure OpenAI Errors
If you see authentication or deployment errors:
- Verify your
AZURE_OPENAI_ENDPOINTis correct - Confirm
AZURE_OPENAI_CHAT_DEPLOYMENT_NAMEmatches your deployment - If using API key, check
AZURE_OPENAI_API_KEYis valid - If using Azure CLI, ensure you're logged in:
az login
CI/CD
For automated testing in CI/CD pipelines:
- Use Docker Compose to start DTS emulator
- Set environment variables via CI/CD secrets
- Run tests with appropriate markers:
pytest -m integration_test