Skip to content
Closed
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 0 additions & 1 deletion Makefile
Original file line number Diff line number Diff line change
Expand Up @@ -117,7 +117,6 @@ start-ogx-container: build-ogx-image ## Start OGX container
-e WATSONX_BASE_URL=$${WATSONX_BASE_URL:-} \
-e WATSONX_PROJECT_ID=$${WATSONX_PROJECT_ID:-} \
-e WATSONX_API_KEY \
-e LITELLM_DROP_PARAMS=true \
-e AWS_BEARER_TOKEN_BEDROCK \
-e OGX_LOGGING=$${OGX_LOGGING:-} \
-e FAISS_VECTOR_STORE_ID=$${FAISS_VECTOR_STORE_ID:-} \
Expand Down
1 change: 0 additions & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -632,7 +632,6 @@ dependencies = [
"opentelemetry-exporter-otlp>=1.34.0",
"opentelemetry-instrumentation>=0.55b0",
"aiosqlite>=0.21.0",
"litellm>=1.72.1",
"uvicorn>=0.34.3",
"blobfile>=3.0.0",
"datasets>=3.6.0",
Expand Down
2 changes: 1 addition & 1 deletion deploy/lightspeed-stack/Containerfile
Original file line number Diff line number Diff line change
Expand Up @@ -23,7 +23,7 @@ USER root

# Install gcc - required by polyleven python package on aarch64
# (dependency of autoevals, no pre-built binary wheels for linux on aarch64)
# cmake and cargo are required by fastuuid, maturin
# cmake and cargo are required for building native extensions
RUN ${BUILDER_DNF_COMMAND} install -y --nodocs --setopt=keepcache=0 --setopt=tsflags=nodocs gcc gcc-c++ cmake cargo && \
${BUILDER_DNF_COMMAND} update -y --nodocs --setopt=keepcache=0 --setopt=tsflags=nodocs --allowerasing

Expand Down
1 change: 0 additions & 1 deletion docker-compose-library.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -59,7 +59,6 @@ services:
- WATSONX_BASE_URL=${WATSONX_BASE_URL:-}
- WATSONX_PROJECT_ID=${WATSONX_PROJECT_ID:-}
- WATSONX_API_KEY=${WATSONX_API_KEY:-}
- LITELLM_DROP_PARAMS=true
# AWS Bedrock
- AWS_BEARER_TOKEN_BEDROCK=${AWS_BEARER_TOKEN_BEDROCK:-}
# Enable debug logging if needed
Expand Down
1 change: 0 additions & 1 deletion docker-compose.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -57,7 +57,6 @@ services:
- WATSONX_BASE_URL=${WATSONX_BASE_URL:-}
- WATSONX_PROJECT_ID=${WATSONX_PROJECT_ID:-}
- WATSONX_API_KEY=${WATSONX_API_KEY:-}
- LITELLM_DROP_PARAMS=true
# AWS Bedrock
- AWS_BEARER_TOKEN_BEDROCK=${AWS_BEARER_TOKEN_BEDROCK:-}
# Enable debug logging if needed
Expand Down
2 changes: 0 additions & 2 deletions docs/basic_info/getting_started.md
Original file line number Diff line number Diff line change
Expand Up @@ -32,7 +32,6 @@ It is possible to run Lightspeed Core Stack service with OGX "embedded" as a Pyt
"opentelemetry-exporter-otlp>=1.34.0" \
"opentelemetry-instrumentation>=0.55b0" \
"aiosqlite>=0.21.0" \
"litellm>=1.72.1" \
"uvicorn>=0.34.3" \
"blobfile>=3.0.0" \
"datasets>=3.6.0" \
Expand Down Expand Up @@ -64,7 +63,6 @@ It is possible to run Lightspeed Core Stack service with OGX "embedded" as a Pyt
+ grpcio==1.74.0
+ httpx-sse==0.4.1
~ lightspeed-stack==0.2.0 (from file:///tmp/ramdisk/lightspeed-stack)
+ litellm==1.74.9.post1
+ lxml==6.0.0
+ mcp==1.12.2
+ mpmath==1.3.0
Expand Down
2 changes: 1 addition & 1 deletion docs/demos/lcore/lcore.md
Original file line number Diff line number Diff line change
Expand Up @@ -183,7 +183,7 @@ Python ecosystem
pdm init
pdm add ogx ogx-api ogx-client fastapi opentelemetry-sdk \
opentelemetry-exporter-otlp opentelemetry-instrumentation \
aiosqlite litellm uvicorn blobfile
aiosqlite uvicorn blobfile
```

---
Expand Down
1 change: 0 additions & 1 deletion docs/devel_doc/container_orchestration.md
Original file line number Diff line number Diff line change
Expand Up @@ -314,7 +314,6 @@ See [OKP Guide](okp_guide.md) for detailed setup instructions.
- `E2E_OPENAI_MODEL`: OpenAI model for E2E tests (default: `gpt-5.6-luna`)
- `OGX_LOGGING`: Enable debug logging in OGX
- `FAISS_VECTOR_STORE_ID`: FAISS vector store identifier
- `LITELLM_DROP_PARAMS`: Drop unsupported params in LiteLLM (default: `true`)

#### Setting Environment Variables

Expand Down
14 changes: 7 additions & 7 deletions docs/devel_doc/providers.md
Original file line number Diff line number Diff line change
Expand Up @@ -35,27 +35,27 @@ The tables below summarize each provider category, containing the following atri
|-----------------------|--------|-----------------------------------------------------------------------------------------------------------------------------------------------------------------------|:----------------:|
| meta-reference | inline | `accelerate`, `fairscale`, `torch`, `torchvision`, `transformers`, `zmq`, `lm-format-enforcer`, `sentence-transformers`, `torchao==0.8.0`, `fbgemm-gpu-genai==1.1.2` | ❌ |
| sentence-transformers | inline | `torch torchvision torchao>=0.12.0 --extra-index-url https://download.pytorch.org/whl/cpu`, `sentence-transformers --no-deps` | ❌ |
| anthropic | remote | `litellm` | ❌ |
| anthropic | remote | — | ❌ |
| azure | remote | — | ✅ |
| bedrock | remote | - | ✅ |
| cerebras | remote | `cerebras_cloud_sdk` | ❌ |
| databricks | remote | — | ❌ |
| fireworks | remote | `fireworks-ai<=0.17.16` | ❌ |
| gemini | remote | `litellm` | ❌ |
| groq | remote | `litellm` | ❌ |
| gemini | remote | — | ❌ |
| groq | remote | — | ❌ |
| hf::endpoint | remote | `huggingface_hub`, `aiohttp` | ❌ |
| hf::serverless | remote | `huggingface_hub`, `aiohttp` | ❌ |
| llama-openai-compat | remote | `litellm` | ❌ |
| llama-openai-compat | remote | — | ❌ |
| nvidia | remote | — | ❌ |
| ollama | remote | `ollama`, `aiohttp`, `h11>=0.16.0` | ❌ |
| openai | remote | `litellm` | ✅ |
| openai | remote | — | ✅ |
| passthrough | remote | — | ❌ |
| runpod | remote | — | ❌ |
| sambanova | remote | `litellm` | ❌ |
| sambanova | remote | — | ❌ |
| tgi | remote | `huggingface_hub`, `aiohttp` | ❌ |
| together | remote | `together` | ❌ |
| vertexai | remote | `google-auth` | ✅ |
| watsonx | remote | `litellm` | ✅ |
| watsonx | remote | — | ✅ |

Red Hat providers:

Expand Down
1 change: 0 additions & 1 deletion docs/user_doc/deployment_guide.md
Original file line number Diff line number Diff line change
Expand Up @@ -889,7 +889,6 @@ a4982f43195537b9eb1cec510fe6655f245d6d4b7236a4759808115d5d719972
"opentelemetry-exporter-otlp>=1.34.0",
"opentelemetry-instrumentation>=0.55b0",
"aiosqlite>=0.21.0",
"litellm>=1.72.1",
"uvicorn>=0.34.3",
"blobfile>=3.0.0",
"datasets>=3.6.0",
Expand Down
1 change: 0 additions & 1 deletion examples/pyproject.ogx.toml
Original file line number Diff line number Diff line change
Expand Up @@ -12,7 +12,6 @@ dependencies = [
"opentelemetry-exporter-otlp>=1.34.0",
"opentelemetry-instrumentation>=0.55b0",
"aiosqlite>=0.21.0",
"litellm>=1.72.1",
"uvicorn>=0.34.3",
"blobfile>=3.0.0",
"datasets>=3.6.0",
Expand Down
2 changes: 1 addition & 1 deletion pyproject.toml
Original file line number Diff line number Diff line change
Expand Up @@ -93,7 +93,7 @@ dependencies = [
# Used by the redaction engine (src/pii_redaction_engine) for PII detection/redaction
"presidio-analyzer>=2.2.364",
"presidio-anonymizer>=2.2.364",
"boto3",
"boto3>=1.35.0",
"nh3>=0.3.6",
]

Expand Down
Loading