Files
agent-framework/python/packages/durabletask/tests/integration_tests
T
Eduard van Valkenburg acc49196c1 Python: updated integration tests and guidance (#4181)
* updated integration tests and guidance

* fixed merge test

* updated integration tests

* fix: remove duplicate --dist loadfile flag from pytest-xdist config

Only one --dist mode can be active at a time; the second value silently
overrides the first. Keep --dist worksteal (dynamic load balancing) and
remove the redundant --dist loadfile from all workflow files and
pyproject.toml configs.

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>

* docs: add keep-in-sync notes for merge and integration test workflows

Both python-merge-tests.yml and python-integration-tests.yml share the
same parallel job structure. Added sync reminders in workflow file
comments, the python-testing SKILL.md, and CODING_STANDARD.md.

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>

* refactor: remove RUN_INTEGRATION_TESTS flag

Integration test gating now uses two mechanisms:
- `@pytest.mark.integration` for test selection via `-m` filtering
- `skip_if_*_disabled` for credential/service availability checks

The RUN_INTEGRATION_TESTS env var was redundant since the marker handles
selection and the skip decorators already check for actual credentials.

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>

* fix: sync missing env vars from merge-tests to integration-tests

Add OPENAI_EMBEDDINGS_MODEL_ID and AZURE_OPENAI_EMBEDDING_DEPLOYMENT_NAME
to python-integration-tests.yml to match python-merge-tests.yml.

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>

* fix: remove remaining RUN_INTEGRATION_TESTS from embedding tests and docs

Missed test_openai_embedding_client.py and vector-stores README in the
earlier cleanup.

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>

* set functions tests to 3.10

---------

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
acc49196c1 ยท 2026-02-24 09:35:46 +00:00
History
..

Sample Integration Tests

Integration tests that validate the Durable Agent Framework samples by running them against a Durable Task Scheduler (DTS) instance.

Setup

1. Create .env file

Copy .env.example to .env and fill in your Azure credentials:

cp .env.example .env

Required variables:

  • AZURE_OPENAI_ENDPOINT
  • AZURE_OPENAI_CHAT_DEPLOYMENT_NAME
  • AZURE_OPENAI_API_KEY (optional if using Azure CLI authentication)
  • ENDPOINT (default: http://localhost:8080)
  • TASKHUB (default: default)

Optional variables (for streaming tests):

  • REDIS_CONNECTION_STRING (default: redis://localhost:6379)
  • REDIS_STREAM_TTL_MINUTES (default: 10)

2. Start required services

Durable Task Scheduler:

docker run -d --name dts-emulator -p 8080:8080 -p 8082:8082 mcr.microsoft.com/dts/dts-emulator:latest
  • Port 8080: gRPC endpoint (used by tests)
  • Port 8082: Web dashboard (optional, for monitoring)

Redis (for streaming tests):

docker run -d --name redis -p 6379:6379 redis:latest
  • Port 6379: Redis server endpoint

Running Tests

The tests automatically start and stop worker processes for each sample.

Run all sample tests

uv run pytest packages/durabletask/tests/integration_tests -v

Run specific sample

uv run pytest packages/durabletask/tests/integration_tests/test_01_single_agent.py -v

Run with verbose output

uv run pytest packages/durabletask/tests/integration_tests -sv

How It Works

Each test file uses pytest markers to automatically configure and start the worker process:

pytestmark = [
    pytest.mark.sample("03_single_agent_streaming"),
    pytest.mark.integration_test,
    pytest.mark.requires_azure_openai,
    pytest.mark.requires_dts,
    pytest.mark.requires_redis,
]

Troubleshooting

Tests are skipped: Ensure the required environment variables (e.g., AZURE_OPENAI_ENDPOINT) are set in your .env file.

DTS connection failed: Check that the DTS emulator container is running: docker ps | grep dts-emulator

Redis connection failed: Check that Redis is running: docker ps | grep redis

Missing environment variables: Ensure your .env file contains all required variables from .env.example.

Tests timeout: Check that Azure OpenAI credentials are valid and the service is accessible.

If you see "DTS emulator is not available":

  • Ensure Docker container is running: docker ps | grep dts-emulator
  • Check port 8080 is not in use by another process
  • Restart the container if needed

Azure OpenAI Errors

If you see authentication or deployment errors:

  • Verify your AZURE_OPENAI_ENDPOINT is correct
  • Confirm AZURE_OPENAI_CHAT_DEPLOYMENT_NAME matches your deployment
  • If using API key, check AZURE_OPENAI_API_KEY is valid
  • If using Azure CLI, ensure you're logged in: az login

CI/CD

For automated testing in CI/CD pipelines:

  1. Use Docker Compose to start DTS emulator
  2. Set environment variables via CI/CD secrets
  3. Run tests with appropriate markers: pytest -m integration_test