Bawwab: Top 302 scan

deepeval

Not malicious, needs a look Reviewed: expected behaviour

Bawwab's static rules found patterns that deserve a human look. This is not a finding that the package is malicious; the review notes below say what each pattern turned out to be.

Why it was flagged

The static rules marked this “Not malicious, needs a look” because of:

Kind
Plugin
Source
github
Repository
confident-ai/deepeval
Commit
da9b2c969f8a15e8aa4ef67c372157ce060cd63e
Listed in
anthropics/claude-plugins-official
Popularity
19,576 GitHub stars (2026-11-20) (official, always included)
Link
https://github.com/confident-ai/deepeval/tree/da9b2c969f8a15e8aa4ef67c372157ce060cd63e
Scanned
2026-11-20T23:13:57+00:00
Scan time
132.7 s
Scanned as
plugin
Review note: deepeval flags are help text, tests and its own settings loader reading .env files in your project; nothing malicious.

Findings (41)

install-script: Runs code at install time med

docs/package.json:18

OWASP LLM LLM03 Supply ChainOWASP Agentic ASI04 Agentic Supply Chain VulnerabilitiesOWASP Agentic ASI05 Unexpected Code Execution (RCE)MITRE ATLAS AML.T0010.001 Supply Chain Compromise: SoftwareMITRE ATLAS AML.T0011.001 User Execution: Malicious Package

fumadocs-mdx

What this means: Install hooks run automatically with your privileges before you can review anything.

The rule's general advice: Read the script; prefer packages with no install hooks. (see the review note for this case)

Known false alarm

The postinstall script belongs to the documentation website (docs/package.json) and runs the fumadocs-mdx content generator when someone builds the docs. It is not part of installing the plugin or the deepeval library.

Reviewed by Claude (AI-assisted review), 2026-11-21

credential-access: Touches credentials or secrets high

pyproject.toml:93

OWASP LLM LLM03 Supply ChainOWASP Agentic ASI03 Identity and Privilege AbuseOWASP Agentic ASI04 Agentic Supply Chain VulnerabilitiesMITRE ATLAS AML.T0055 Unsecured CredentialsMITRE ATLAS AML.T0083 Credentials from AI Agent Configuration

"enable_dotenv: allow this test to load .env files via autoload_dotenv()",

What this means: Reads files or environment holding keys, tokens or sessions.

The rule's general advice: Confirm the tool needs this; otherwise do not install. (see the review note for this case)

Known false alarm

A pytest marker description in pyproject.toml that lets specific tests load .env files. Just a text label.

Reviewed by Claude (AI-assisted review), 2026-11-21

credential-access: Touches credentials or secrets high

deepeval/key_handler.py:238

OWASP LLM LLM03 Supply ChainOWASP Agentic ASI03 Identity and Privilege AbuseOWASP Agentic ASI04 Agentic Supply Chain VulnerabilitiesMITRE ATLAS AML.T0055 Unsecured CredentialsMITRE ATLAS AML.T0083 Credentials from AI Agent Configuration

"Keep your secrets in .env or .env.local instead.",

What this means: Reads files or environment holding keys, tokens or sessions.

The rule's general advice: Confirm the tool needs this; otherwise do not install. (see the review note for this case)

Expected for what this tool does

deepeval's CLI and settings code load provider API keys from .env, .env.<APP_ENV> and .env.local in your project folder, and `--save=dotenv` writes keys you type into .env.local (file mode 0600). Most flagged lines are help text. Keys are used only to call the LLM providers you configure; nothing sends them elsewhere.

Reviewed by Claude (AI-assisted review), 2026-11-21

credential-access: Touches credentials or secrets high

deepeval/cli/dotenv_handler.py:12

OWASP LLM LLM03 Supply ChainOWASP Agentic ASI03 Identity and Privilege AbuseOWASP Agentic ASI04 Agentic Supply Chain VulnerabilitiesMITRE ATLAS AML.T0055 Unsecured CredentialsMITRE ATLAS AML.T0083 Credentials from AI Agent Configuration

def __init__(self, path: str | Path = ".env.local"):

What this means: Reads files or environment holding keys, tokens or sessions.

The rule's general advice: Confirm the tool needs this; otherwise do not install. (see the review note for this case)

Expected for what this tool does

deepeval's CLI and settings code load provider API keys from .env, .env.<APP_ENV> and .env.local in your project folder, and `--save=dotenv` writes keys you type into .env.local (file mode 0600). Most flagged lines are help text. Keys are used only to call the LLM providers you configure; nothing sends them elsewhere.

Reviewed by Claude (AI-assisted review), 2026-11-21

credential-access: Touches credentials or secrets high

deepeval/cli/main.py:11

OWASP LLM LLM03 Supply ChainOWASP Agentic ASI03 Identity and Privilege AbuseOWASP Agentic ASI04 Agentic Supply Chain VulnerabilitiesMITRE ATLAS AML.T0055 Unsecured CredentialsMITRE ATLAS AML.T0083 Credentials from AI Agent Configuration

written to the specified dotenv file (default: `.env.local`).

What this means: Reads files or environment holding keys, tokens or sessions.

The rule's general advice: Confirm the tool needs this; otherwise do not install. (see the review note for this case)

Expected for what this tool does

deepeval's CLI and settings code load provider API keys from .env, .env.<APP_ENV> and .env.local in your project folder, and `--save=dotenv` writes keys you type into .env.local (file mode 0600). Most flagged lines are help text. Keys are used only to call the LLM providers you configure; nothing sends them elsewhere.

Reviewed by Claude (AI-assisted review), 2026-11-21

credential-access: Touches credentials or secrets high

deepeval/cli/utils.py:253

OWASP LLM LLM03 Supply ChainOWASP Agentic ASI03 Identity and Privilege AbuseOWASP Agentic ASI04 Agentic Supply Chain VulnerabilitiesMITRE ATLAS AML.T0055 Unsecured CredentialsMITRE ATLAS AML.T0083 Credentials from AI Agent Configuration

save_opt: Optional[str] = None, default_path: str = ".env.local"

What this means: Reads files or environment holding keys, tokens or sessions.

The rule's general advice: Confirm the tool needs this; otherwise do not install. (see the review note for this case)

Expected for what this tool does

deepeval's CLI and settings code load provider API keys from .env, .env.<APP_ENV> and .env.local in your project folder, and `--save=dotenv` writes keys you type into .env.local (file mode 0600). Most flagged lines are help text. Keys are used only to call the LLM providers you configure; nothing sends them elsewhere.

Reviewed by Claude (AI-assisted review), 2026-11-21

credential-access: Touches credentials or secrets high

deepeval/cli/auth/command.py:53

OWASP LLM LLM03 Supply ChainOWASP Agentic ASI03 Identity and Privilege AbuseOWASP Agentic ASI04 Agentic Supply Chain VulnerabilitiesMITRE ATLAS AML.T0055 Unsecured CredentialsMITRE ATLAS AML.T0083 Credentials from AI Agent Configuration

"The key is saved to your environment variables, typically .env.local, "

What this means: Reads files or environment holding keys, tokens or sessions.

The rule's general advice: Confirm the tool needs this; otherwise do not install. (see the review note for this case)

Expected for what this tool does

deepeval's CLI and settings code load provider API keys from .env, .env.<APP_ENV> and .env.local in your project folder, and `--save=dotenv` writes keys you type into .env.local (file mode 0600). Most flagged lines are help text. Keys are used only to call the LLM providers you configure; nothing sends them elsewhere.

Reviewed by Claude (AI-assisted review), 2026-11-21

credential-access: Touches credentials or secrets high

deepeval/cli/diagnose/diagnose.py:159

OWASP LLM LLM03 Supply ChainOWASP Agentic ASI03 Identity and Privilege AbuseOWASP Agentic ASI04 Agentic Supply Chain VulnerabilitiesMITRE ATLAS AML.T0055 Unsecured CredentialsMITRE ATLAS AML.T0083 Credentials from AI Agent Configuration

Mirrors runtime precedence: process env > dotenv (.env.local >

What this means: Reads files or environment holding keys, tokens or sessions.

The rule's general advice: Confirm the tool needs this; otherwise do not install. (see the review note for this case)

Expected for what this tool does

deepeval's CLI and settings code load provider API keys from .env, .env.<APP_ENV> and .env.local in your project folder, and `--save=dotenv` writes keys you type into .env.local (file mode 0600). Most flagged lines are help text. Keys are used only to call the LLM providers you configure; nothing sends them elsewhere.

Reviewed by Claude (AI-assisted review), 2026-11-21

credential-access: Touches credentials or secrets high

deepeval/cli/providers/llms/anthropic.py:60

OWASP LLM LLM03 Supply ChainOWASP Agentic ASI03 Identity and Privilege AbuseOWASP Agentic ASI04 Agentic Supply Chain VulnerabilitiesMITRE ATLAS AML.T0055 Unsecured CredentialsMITRE ATLAS AML.T0083 Credentials from AI Agent Configuration

"Usage: --save=dotenv[:path] (default: .env.local)",

What this means: Reads files or environment holding keys, tokens or sessions.

The rule's general advice: Confirm the tool needs this; otherwise do not install. (see the review note for this case)

Expected for what this tool does

deepeval's CLI and settings code load provider API keys from .env, .env.<APP_ENV> and .env.local in your project folder, and `--save=dotenv` writes keys you type into .env.local (file mode 0600). Most flagged lines are help text. Keys are used only to call the LLM providers you configure; nothing sends them elsewhere.

Reviewed by Claude (AI-assisted review), 2026-11-21

credential-access: Touches credentials or secrets high

deepeval/cli/providers/llms/azure.py:61

OWASP LLM LLM03 Supply ChainOWASP Agentic ASI03 Identity and Privilege AbuseOWASP Agentic ASI04 Agentic Supply Chain VulnerabilitiesMITRE ATLAS AML.T0055 Unsecured CredentialsMITRE ATLAS AML.T0083 Credentials from AI Agent Configuration

"Usage: --save=dotenv[:path] (default: .env.local)",

What this means: Reads files or environment holding keys, tokens or sessions.

The rule's general advice: Confirm the tool needs this; otherwise do not install. (see the review note for this case)

Expected for what this tool does

deepeval's CLI and settings code load provider API keys from .env, .env.<APP_ENV> and .env.local in your project folder, and `--save=dotenv` writes keys you type into .env.local (file mode 0600). Most flagged lines are help text. Keys are used only to call the LLM providers you configure; nothing sends them elsewhere.

Reviewed by Claude (AI-assisted review), 2026-11-21

credential-access: Touches credentials or secrets high

deepeval/cli/providers/llms/bedrock.py:66

OWASP LLM LLM03 Supply ChainOWASP Agentic ASI03 Identity and Privilege AbuseOWASP Agentic ASI04 Agentic Supply Chain VulnerabilitiesMITRE ATLAS AML.T0055 Unsecured CredentialsMITRE ATLAS AML.T0083 Credentials from AI Agent Configuration

"Usage: --save=dotenv[:path] (default: .env.local)",

What this means: Reads files or environment holding keys, tokens or sessions.

The rule's general advice: Confirm the tool needs this; otherwise do not install. (see the review note for this case)

Expected for what this tool does

deepeval's CLI and settings code load provider API keys from .env, .env.<APP_ENV> and .env.local in your project folder, and `--save=dotenv` writes keys you type into .env.local (file mode 0600). Most flagged lines are help text. Keys are used only to call the LLM providers you configure; nothing sends them elsewhere.

Reviewed by Claude (AI-assisted review), 2026-11-21

credential-access: Touches credentials or secrets high

deepeval/cli/providers/llms/deepseek.py:60

OWASP LLM LLM03 Supply ChainOWASP Agentic ASI03 Identity and Privilege AbuseOWASP Agentic ASI04 Agentic Supply Chain VulnerabilitiesMITRE ATLAS AML.T0055 Unsecured CredentialsMITRE ATLAS AML.T0083 Credentials from AI Agent Configuration

"Usage: --save=dotenv[:path] (default: .env.local)",

What this means: Reads files or environment holding keys, tokens or sessions.

The rule's general advice: Confirm the tool needs this; otherwise do not install. (see the review note for this case)

Expected for what this tool does

deepeval's CLI and settings code load provider API keys from .env, .env.<APP_ENV> and .env.local in your project folder, and `--save=dotenv` writes keys you type into .env.local (file mode 0600). Most flagged lines are help text. Keys are used only to call the LLM providers you configure; nothing sends them elsewhere.

Reviewed by Claude (AI-assisted review), 2026-11-21

credential-access: Touches credentials or secrets high

deepeval/cli/providers/llms/gemini.py:65

OWASP LLM LLM03 Supply ChainOWASP Agentic ASI03 Identity and Privilege AbuseOWASP Agentic ASI04 Agentic Supply Chain VulnerabilitiesMITRE ATLAS AML.T0055 Unsecured CredentialsMITRE ATLAS AML.T0083 Credentials from AI Agent Configuration

"Usage: --save=dotenv[:path] (default: .env.local)",

What this means: Reads files or environment holding keys, tokens or sessions.

The rule's general advice: Confirm the tool needs this; otherwise do not install. (see the review note for this case)

Expected for what this tool does

deepeval's CLI and settings code load provider API keys from .env, .env.<APP_ENV> and .env.local in your project folder, and `--save=dotenv` writes keys you type into .env.local (file mode 0600). Most flagged lines are help text. Keys are used only to call the LLM providers you configure; nothing sends them elsewhere.

Reviewed by Claude (AI-assisted review), 2026-11-21

credential-access: Touches credentials or secrets high

deepeval/cli/providers/llms/grok.py:60

OWASP LLM LLM03 Supply ChainOWASP Agentic ASI03 Identity and Privilege AbuseOWASP Agentic ASI04 Agentic Supply Chain VulnerabilitiesMITRE ATLAS AML.T0055 Unsecured CredentialsMITRE ATLAS AML.T0083 Credentials from AI Agent Configuration

"Usage: --save=dotenv[:path] (default: .env.local)",

What this means: Reads files or environment holding keys, tokens or sessions.

The rule's general advice: Confirm the tool needs this; otherwise do not install. (see the review note for this case)

Expected for what this tool does

deepeval's CLI and settings code load provider API keys from .env, .env.<APP_ENV> and .env.local in your project folder, and `--save=dotenv` writes keys you type into .env.local (file mode 0600). Most flagged lines are help text. Keys are used only to call the LLM providers you configure; nothing sends them elsewhere.

Reviewed by Claude (AI-assisted review), 2026-11-21

credential-access: Touches credentials or secrets high

deepeval/cli/providers/llms/litellm.py:63

OWASP LLM LLM03 Supply ChainOWASP Agentic ASI03 Identity and Privilege AbuseOWASP Agentic ASI04 Agentic Supply Chain VulnerabilitiesMITRE ATLAS AML.T0055 Unsecured CredentialsMITRE ATLAS AML.T0083 Credentials from AI Agent Configuration

"Usage: --save=dotenv[:path] (default: .env.local)",

What this means: Reads files or environment holding keys, tokens or sessions.

The rule's general advice: Confirm the tool needs this; otherwise do not install. (see the review note for this case)

Expected for what this tool does

deepeval's CLI and settings code load provider API keys from .env, .env.<APP_ENV> and .env.local in your project folder, and `--save=dotenv` writes keys you type into .env.local (file mode 0600). Most flagged lines are help text. Keys are used only to call the LLM providers you configure; nothing sends them elsewhere.

Reviewed by Claude (AI-assisted review), 2026-11-21

credential-access: Touches credentials or secrets high

deepeval/cli/providers/llms/local_embeddings.py:48

OWASP LLM LLM03 Supply ChainOWASP Agentic ASI03 Identity and Privilege AbuseOWASP Agentic ASI04 Agentic Supply Chain VulnerabilitiesMITRE ATLAS AML.T0055 Unsecured CredentialsMITRE ATLAS AML.T0083 Credentials from AI Agent Configuration

"Usage: --save=dotenv[:path] (default: .env.local)",

What this means: Reads files or environment holding keys, tokens or sessions.

The rule's general advice: Confirm the tool needs this; otherwise do not install. (see the review note for this case)

Expected for what this tool does

deepeval's CLI and settings code load provider API keys from .env, .env.<APP_ENV> and .env.local in your project folder, and `--save=dotenv` writes keys you type into .env.local (file mode 0600). Most flagged lines are help text. Keys are used only to call the LLM providers you configure; nothing sends them elsewhere.

Reviewed by Claude (AI-assisted review), 2026-11-21

credential-access: Touches credentials or secrets high

deepeval/cli/providers/llms/local_model.py:54

OWASP LLM LLM03 Supply ChainOWASP Agentic ASI03 Identity and Privilege AbuseOWASP Agentic ASI04 Agentic Supply Chain VulnerabilitiesMITRE ATLAS AML.T0055 Unsecured CredentialsMITRE ATLAS AML.T0083 Credentials from AI Agent Configuration

"Usage: --save=dotenv[:path] (default: .env.local)",

What this means: Reads files or environment holding keys, tokens or sessions.

The rule's general advice: Confirm the tool needs this; otherwise do not install. (see the review note for this case)

Expected for what this tool does

deepeval's CLI and settings code load provider API keys from .env, .env.<APP_ENV> and .env.local in your project folder, and `--save=dotenv` writes keys you type into .env.local (file mode 0600). Most flagged lines are help text. Keys are used only to call the LLM providers you configure; nothing sends them elsewhere.

Reviewed by Claude (AI-assisted review), 2026-11-21

credential-access: Touches credentials or secrets high

deepeval/cli/providers/llms/moonshot.py:60

OWASP LLM LLM03 Supply ChainOWASP Agentic ASI03 Identity and Privilege AbuseOWASP Agentic ASI04 Agentic Supply Chain VulnerabilitiesMITRE ATLAS AML.T0055 Unsecured CredentialsMITRE ATLAS AML.T0083 Credentials from AI Agent Configuration

"Usage: --save=dotenv[:path] (default: .env.local)",

What this means: Reads files or environment holding keys, tokens or sessions.

The rule's general advice: Confirm the tool needs this; otherwise do not install. (see the review note for this case)

Expected for what this tool does

deepeval's CLI and settings code load provider API keys from .env, .env.<APP_ENV> and .env.local in your project folder, and `--save=dotenv` writes keys you type into .env.local (file mode 0600). Most flagged lines are help text. Keys are used only to call the LLM providers you configure; nothing sends them elsewhere.

Reviewed by Claude (AI-assisted review), 2026-11-21

credential-access: Touches credentials or secrets high

deepeval/cli/providers/llms/ollama.py:40

OWASP LLM LLM03 Supply ChainOWASP Agentic ASI03 Identity and Privilege AbuseOWASP Agentic ASI04 Agentic Supply Chain VulnerabilitiesMITRE ATLAS AML.T0055 Unsecured CredentialsMITRE ATLAS AML.T0083 Credentials from AI Agent Configuration

"Usage: --save=dotenv[:path] (default: .env.local)",

What this means: Reads files or environment holding keys, tokens or sessions.

The rule's general advice: Confirm the tool needs this; otherwise do not install. (see the review note for this case)

Expected for what this tool does

deepeval's CLI and settings code load provider API keys from .env, .env.<APP_ENV> and .env.local in your project folder, and `--save=dotenv` writes keys you type into .env.local (file mode 0600). Most flagged lines are help text. Keys are used only to call the LLM providers you configure; nothing sends them elsewhere.

Reviewed by Claude (AI-assisted review), 2026-11-21

credential-access: Touches credentials or secrets high

deepeval/cli/providers/llms/openai.py:60

OWASP LLM LLM03 Supply ChainOWASP Agentic ASI03 Identity and Privilege AbuseOWASP Agentic ASI04 Agentic Supply Chain VulnerabilitiesMITRE ATLAS AML.T0055 Unsecured CredentialsMITRE ATLAS AML.T0083 Credentials from AI Agent Configuration

"Usage: --save=dotenv[:path] (default: .env.local)",

What this means: Reads files or environment holding keys, tokens or sessions.

The rule's general advice: Confirm the tool needs this; otherwise do not install. (see the review note for this case)

Expected for what this tool does

deepeval's CLI and settings code load provider API keys from .env, .env.<APP_ENV> and .env.local in your project folder, and `--save=dotenv` writes keys you type into .env.local (file mode 0600). Most flagged lines are help text. Keys are used only to call the LLM providers you configure; nothing sends them elsewhere.

Reviewed by Claude (AI-assisted review), 2026-11-21

credential-access: Touches credentials or secrets high

deepeval/cli/providers/llms/openrouter.py:74

OWASP LLM LLM03 Supply ChainOWASP Agentic ASI03 Identity and Privilege AbuseOWASP Agentic ASI04 Agentic Supply Chain VulnerabilitiesMITRE ATLAS AML.T0055 Unsecured CredentialsMITRE ATLAS AML.T0083 Credentials from AI Agent Configuration

"Usage: --save=dotenv[:path] (default: .env.local)",

What this means: Reads files or environment holding keys, tokens or sessions.

The rule's general advice: Confirm the tool needs this; otherwise do not install. (see the review note for this case)

Expected for what this tool does

deepeval's CLI and settings code load provider API keys from .env, .env.<APP_ENV> and .env.local in your project folder, and `--save=dotenv` writes keys you type into .env.local (file mode 0600). Most flagged lines are help text. Keys are used only to call the LLM providers you configure; nothing sends them elsewhere.

Reviewed by Claude (AI-assisted review), 2026-11-21

credential-access: Touches credentials or secrets high

deepeval/cli/providers/llms/portkey.py:54

OWASP LLM LLM03 Supply ChainOWASP Agentic ASI03 Identity and Privilege AbuseOWASP Agentic ASI04 Agentic Supply Chain VulnerabilitiesMITRE ATLAS AML.T0055 Unsecured CredentialsMITRE ATLAS AML.T0083 Credentials from AI Agent Configuration

"Usage: --save=dotenv[:path] (default: .env.local)",

What this means: Reads files or environment holding keys, tokens or sessions.

The rule's general advice: Confirm the tool needs this; otherwise do not install. (see the review note for this case)

Expected for what this tool does

deepeval's CLI and settings code load provider API keys from .env, .env.<APP_ENV> and .env.local in your project folder, and `--save=dotenv` writes keys you type into .env.local (file mode 0600). Most flagged lines are help text. Keys are used only to call the LLM providers you configure; nothing sends them elsewhere.

Reviewed by Claude (AI-assisted review), 2026-11-21

credential-access: Touches credentials or secrets high

deepeval/cli/providers/stt/command.py:50

OWASP LLM LLM03 Supply ChainOWASP Agentic ASI03 Identity and Privilege AbuseOWASP Agentic ASI04 Agentic Supply Chain VulnerabilitiesMITRE ATLAS AML.T0055 Unsecured CredentialsMITRE ATLAS AML.T0083 Credentials from AI Agent Configuration

"Usage: --save=dotenv[:path] (default: .env.local)",

What this means: Reads files or environment holding keys, tokens or sessions.

The rule's general advice: Confirm the tool needs this; otherwise do not install. (see the review note for this case)

Expected for what this tool does

deepeval's CLI and settings code load provider API keys from .env, .env.<APP_ENV> and .env.local in your project folder, and `--save=dotenv` writes keys you type into .env.local (file mode 0600). Most flagged lines are help text. Keys are used only to call the LLM providers you configure; nothing sends them elsewhere.

Reviewed by Claude (AI-assisted review), 2026-11-21

credential-access: Touches credentials or secrets high

deepeval/cli/providers/system_one/typesafe.py:46

OWASP LLM LLM03 Supply ChainOWASP Agentic ASI03 Identity and Privilege AbuseOWASP Agentic ASI04 Agentic Supply Chain VulnerabilitiesMITRE ATLAS AML.T0055 Unsecured CredentialsMITRE ATLAS AML.T0083 Credentials from AI Agent Configuration

"Usage: --save=dotenv[:path] (default: .env.local)",

What this means: Reads files or environment holding keys, tokens or sessions.

The rule's general advice: Confirm the tool needs this; otherwise do not install. (see the review note for this case)

Expected for what this tool does

deepeval's CLI and settings code load provider API keys from .env, .env.<APP_ENV> and .env.local in your project folder, and `--save=dotenv` writes keys you type into .env.local (file mode 0600). Most flagged lines are help text. Keys are used only to call the LLM providers you configure; nothing sends them elsewhere.

Reviewed by Claude (AI-assisted review), 2026-11-21

credential-access: Touches credentials or secrets high

deepeval/cli/providers/tts/command.py:49

OWASP LLM LLM03 Supply ChainOWASP Agentic ASI03 Identity and Privilege AbuseOWASP Agentic ASI04 Agentic Supply Chain VulnerabilitiesMITRE ATLAS AML.T0055 Unsecured CredentialsMITRE ATLAS AML.T0083 Credentials from AI Agent Configuration

"Usage: --save=dotenv[:path] (default: .env.local)",

What this means: Reads files or environment holding keys, tokens or sessions.

The rule's general advice: Confirm the tool needs this; otherwise do not install. (see the review note for this case)

Expected for what this tool does

deepeval's CLI and settings code load provider API keys from .env, .env.<APP_ENV> and .env.local in your project folder, and `--save=dotenv` writes keys you type into .env.local (file mode 0600). Most flagged lines are help text. Keys are used only to call the LLM providers you configure; nothing sends them elsewhere.

Reviewed by Claude (AI-assisted review), 2026-11-21

credential-access: Touches credentials or secrets high

deepeval/config/settings.py:5

OWASP LLM LLM03 Supply ChainOWASP Agentic ASI03 Identity and Privilege AbuseOWASP Agentic ASI04 Agentic Supply Chain VulnerabilitiesMITRE ATLAS AML.T0055 Unsecured CredentialsMITRE ATLAS AML.T0083 Credentials from AI Agent Configuration

(order: .env -> .env.{APP_ENV} -> .env.local).

What this means: Reads files or environment holding keys, tokens or sessions.

The rule's general advice: Confirm the tool needs this; otherwise do not install. (see the review note for this case)

Expected for what this tool does

deepeval's CLI and settings code load provider API keys from .env, .env.<APP_ENV> and .env.local in your project folder, and `--save=dotenv` writes keys you type into .env.local (file mode 0600). Most flagged lines are help text. Keys are used only to call the LLM providers you configure; nothing sends them elsewhere.

Reviewed by Claude (AI-assisted review), 2026-11-21

credential-access: Touches credentials or secrets high

deepeval/config/settings_manager.py:58

OWASP LLM LLM03 Supply ChainOWASP Agentic ASI03 Identity and Privilege AbuseOWASP Agentic ASI04 Agentic Supply Chain VulnerabilitiesMITRE ATLAS AML.T0055 Unsecured CredentialsMITRE ATLAS AML.T0083 Credentials from AI Agent Configuration

path = m.group("path") or ".env.local"

What this means: Reads files or environment holding keys, tokens or sessions.

The rule's general advice: Confirm the tool needs this; otherwise do not install. (see the review note for this case)

Expected for what this tool does

deepeval's CLI and settings code load provider API keys from .env, .env.<APP_ENV> and .env.local in your project folder, and `--save=dotenv` writes keys you type into .env.local (file mode 0600). Most flagged lines are help text. Keys are used only to call the LLM providers you configure; nothing sends them elsewhere.

Reviewed by Claude (AI-assisted review), 2026-11-21

remote-code.pipe-shell: Pipes a download into a shell high

docs/lib/wizard/setup-script.ts:146

OWASP LLM LLM03 Supply ChainOWASP Agentic ASI04 Agentic Supply Chain VulnerabilitiesOWASP Agentic ASI05 Unexpected Code Execution (RCE)MITRE ATLAS AML.T0050 Command and Scripting InterpreterCWE CWE-494 Download of Code Without Integrity Check

# curl | sh consumes stdin, so the wizard needs the terminal instead. Only the

What this means: Executes whatever the remote server returns, unreviewed.

The rule's general advice: Download, verify a checksum, then run. (see the review note for this case)

Known false alarm

A comment inside a template for the docs site's setup wizard, explaining why the script reopens the terminal when run via curl | sh. Nothing here pipes a download into a shell at install time.

Reviewed by Claude (AI-assisted review), 2026-11-21

credential-access: Touches credentials or secrets high

tests/test_core/conftest.py:65

OWASP LLM LLM03 Supply ChainOWASP Agentic ASI03 Identity and Privilege AbuseOWASP Agentic ASI04 Agentic Supply Chain VulnerabilitiesMITRE ATLAS AML.T0055 Unsecured CredentialsMITRE ATLAS AML.T0083 Credentials from AI Agent Configuration

return tmp_path / ".env.local"

What this means: Reads files or environment holding keys, tokens or sessions.

The rule's general advice: Confirm the tool needs this; otherwise do not install. (see the review note for this case)

Known false alarm

Test fixtures that write fake .env/.env.local files into a temporary folder to test the settings loader.

Reviewed by Claude (AI-assisted review), 2026-11-21

credential-access: Touches credentials or secrets high

tests/test_core/test_confident_region_routing.py:65

OWASP LLM LLM03 Supply ChainOWASP Agentic ASI03 Identity and Privilege AbuseOWASP Agentic ASI04 Agentic Supply Chain VulnerabilitiesMITRE ATLAS AML.T0055 Unsecured CredentialsMITRE ATLAS AML.T0083 Credentials from AI Agent Configuration

"""Settings (env/.env) outrank the legacy JSON keystore."""

What this means: Reads files or environment holding keys, tokens or sessions.

The rule's general advice: Confirm the tool needs this; otherwise do not install. (see the review note for this case)

Known false alarm

Test fixtures that write fake .env/.env.local files into a temporary folder to test the settings loader.

Reviewed by Claude (AI-assisted review), 2026-11-21

credential-access: Touches credentials or secrets high

tests/test_core/test_config/test_settings.py:18

OWASP LLM LLM03 Supply ChainOWASP Agentic ASI03 Identity and Privilege AbuseOWASP Agentic ASI04 Agentic Supply Chain VulnerabilitiesMITRE ATLAS AML.T0055 Unsecured CredentialsMITRE ATLAS AML.T0083 Credentials from AI Agent Configuration

(env_dir / ".env").write_text("APP_ENV=dev\nFOO=base\n")

What this means: Reads files or environment holding keys, tokens or sessions.

The rule's general advice: Confirm the tool needs this; otherwise do not install. (see the review note for this case)

Known false alarm

Test fixtures that write fake .env/.env.local files into a temporary folder to test the settings loader.

Reviewed by Claude (AI-assisted review), 2026-11-21

credential-access: Touches credentials or secrets high

typescript/src/cli/utils.ts:47

OWASP LLM LLM03 Supply ChainOWASP Agentic ASI03 Identity and Privilege AbuseOWASP Agentic ASI04 Agentic Supply Chain VulnerabilitiesMITRE ATLAS AML.T0055 Unsecured CredentialsMITRE ATLAS AML.T0083 Credentials from AI Agent Configuration

"Usage: --save=dotenv[:path] (default: .env.local)";

What this means: Reads files or environment holding keys, tokens or sessions.

The rule's general advice: Confirm the tool needs this; otherwise do not install. (see the review note for this case)

Expected for what this tool does

The TypeScript SDK mirrors the Python one: it loads its settings and API keys from .env/.env.local in the project folder and saves keys you set with `--save=dotenv` to .env.local. This is the tool's documented configuration path; nothing sends the files elsewhere.

Reviewed by Claude (AI-assisted review), 2026-11-21

credential-access: Touches credentials or secrets high

typescript/src/cli/commands/auth.ts:36

OWASP LLM LLM03 Supply ChainOWASP Agentic ASI03 Identity and Privilege AbuseOWASP Agentic ASI04 Agentic Supply Chain VulnerabilitiesMITRE ATLAS AML.T0055 Unsecured CredentialsMITRE ATLAS AML.T0083 Credentials from AI Agent Configuration

const DEFAULT_SAVE = "dotenv:.env.local";

What this means: Reads files or environment holding keys, tokens or sessions.

The rule's general advice: Confirm the tool needs this; otherwise do not install. (see the review note for this case)

Expected for what this tool does

The TypeScript SDK mirrors the Python one: it loads its settings and API keys from .env/.env.local in the project folder and saves keys you set with `--save=dotenv` to .env.local. This is the tool's documented configuration path; nothing sends the files elsewhere.

Reviewed by Claude (AI-assisted review), 2026-11-21

credential-access: Touches credentials or secrets high

typescript/src/cli/commands/providers.ts:222

OWASP LLM LLM03 Supply ChainOWASP Agentic ASI03 Identity and Privilege AbuseOWASP Agentic ASI04 Agentic Supply Chain VulnerabilitiesMITRE ATLAS AML.T0055 Unsecured CredentialsMITRE ATLAS AML.T0083 Credentials from AI Agent Configuration

"dotenv file. Usage: --save=dotenv[:path] (default: .env.local)",

What this means: Reads files or environment holding keys, tokens or sessions.

The rule's general advice: Confirm the tool needs this; otherwise do not install. (see the review note for this case)

Expected for what this tool does

The TypeScript SDK mirrors the Python one: it loads its settings and API keys from .env/.env.local in the project folder and saves keys you set with `--save=dotenv` to .env.local. This is the tool's documented configuration path; nothing sends the files elsewhere.

Reviewed by Claude (AI-assisted review), 2026-11-21

credential-access: Touches credentials or secrets high

typescript/src/cli/commands/settings.ts:390

OWASP LLM LLM03 Supply ChainOWASP Agentic ASI03 Identity and Privilege AbuseOWASP Agentic ASI04 Agentic Supply Chain VulnerabilitiesMITRE ATLAS AML.T0055 Unsecured CredentialsMITRE ATLAS AML.T0083 Credentials from AI Agent Configuration

"Usage: --save=dotenv[:path] (default: .env.local)",

What this means: Reads files or environment holding keys, tokens or sessions.

The rule's general advice: Confirm the tool needs this; otherwise do not install. (see the review note for this case)

Expected for what this tool does

The TypeScript SDK mirrors the Python one: it loads its settings and API keys from .env/.env.local in the project folder and saves keys you set with `--save=dotenv` to .env.local. This is the tool's documented configuration path; nothing sends the files elsewhere.

Reviewed by Claude (AI-assisted review), 2026-11-21

credential-access: Touches credentials or secrets high

typescript/src/cli/commands/view.ts:33

OWASP LLM LLM03 Supply ChainOWASP Agentic ASI03 Identity and Privilege AbuseOWASP Agentic ASI04 Agentic Supply Chain VulnerabilitiesMITRE ATLAS AML.T0055 Unsecured CredentialsMITRE ATLAS AML.T0083 Credentials from AI Agent Configuration

{ save: "dotenv:.env.local" },

What this means: Reads files or environment holding keys, tokens or sessions.

The rule's general advice: Confirm the tool needs this; otherwise do not install. (see the review note for this case)

Expected for what this tool does

The TypeScript SDK mirrors the Python one: it loads its settings and API keys from .env/.env.local in the project folder and saves keys you set with `--save=dotenv` to .env.local. This is the tool's documented configuration path; nothing sends the files elsewhere.

Reviewed by Claude (AI-assisted review), 2026-11-21

credential-access: Touches credentials or secrets high

typescript/src/config/dotenv-handler.ts:11

OWASP LLM LLM03 Supply ChainOWASP Agentic ASI03 Identity and Privilege AbuseOWASP Agentic ASI04 Agentic Supply Chain VulnerabilitiesMITRE ATLAS AML.T0055 Unsecured CredentialsMITRE ATLAS AML.T0083 Credentials from AI Agent Configuration

constructor(private readonly filePath: string = ".env.local") {}

What this means: Reads files or environment holding keys, tokens or sessions.

The rule's general advice: Confirm the tool needs this; otherwise do not install. (see the review note for this case)

Expected for what this tool does

The TypeScript SDK mirrors the Python one: it loads its settings and API keys from .env/.env.local in the project folder and saves keys you set with `--save=dotenv` to .env.local. This is the tool's documented configuration path; nothing sends the files elsewhere.

Reviewed by Claude (AI-assisted review), 2026-11-21

credential-access: Touches credentials or secrets high

typescript/src/config/dotenv-load.ts:50

OWASP LLM LLM03 Supply ChainOWASP Agentic ASI03 Identity and Privilege AbuseOWASP Agentic ASI04 Agentic Supply Chain VulnerabilitiesMITRE ATLAS AML.T0055 Unsecured CredentialsMITRE ATLAS AML.T0083 Credentials from AI Agent Configuration

for (const file of [".env.local", ".env"]) {

What this means: Reads files or environment holding keys, tokens or sessions.

The rule's general advice: Confirm the tool needs this; otherwise do not install. (see the review note for this case)

Expected for what this tool does

The TypeScript SDK mirrors the Python one: it loads its settings and API keys from .env/.env.local in the project folder and saves keys you set with `--save=dotenv` to .env.local. This is the tool's documented configuration path; nothing sends the files elsewhere.

Reviewed by Claude (AI-assisted review), 2026-11-21

credential-access: Touches credentials or secrets high

typescript/src/config/keystore.ts:51

OWASP LLM LLM03 Supply ChainOWASP Agentic ASI03 Identity and Privilege AbuseOWASP Agentic ASI04 Agentic Supply Chain VulnerabilitiesMITRE ATLAS AML.T0055 Unsecured CredentialsMITRE ATLAS AML.T0083 Credentials from AI Agent Configuration

`${HIDDEN_DIR}/${KEY_FILE}. Keep secrets in .env or .env.local instead.`,

What this means: Reads files or environment holding keys, tokens or sessions.

The rule's general advice: Confirm the tool needs this; otherwise do not install. (see the review note for this case)

Expected for what this tool does

The TypeScript SDK mirrors the Python one: it loads its settings and API keys from .env/.env.local in the project folder and saves keys you set with `--save=dotenv` to .env.local. This is the tool's documented configuration path; nothing sends the files elsewhere.

Reviewed by Claude (AI-assisted review), 2026-11-21

credential-access: Touches credentials or secrets high

typescript/src/config/schema.ts:90

OWASP LLM LLM03 Supply ChainOWASP Agentic ASI03 Identity and Privilege AbuseOWASP Agentic ASI04 Agentic Supply Chain VulnerabilitiesMITRE ATLAS AML.T0055 Unsecured CredentialsMITRE ATLAS AML.T0083 Credentials from AI Agent Configuration

"Application environment name used for dotenv selection (loads .env.<APP_ENV> if present).",

What this means: Reads files or environment holding keys, tokens or sessions.

The rule's general advice: Confirm the tool needs this; otherwise do not install. (see the review note for this case)

Expected for what this tool does

The TypeScript SDK mirrors the Python one: it loads its settings and API keys from .env/.env.local in the project folder and saves keys you set with `--save=dotenv` to .env.local. This is the tool's documented configuration path; nothing sends the files elsewhere.

Reviewed by Claude (AI-assisted review), 2026-11-21

credential-access: Touches credentials or secrets high

typescript/src/config/settings.ts:24

OWASP LLM LLM03 Supply ChainOWASP Agentic ASI03 Identity and Privilege AbuseOWASP Agentic ASI04 Agentic Supply Chain VulnerabilitiesMITRE ATLAS AML.T0055 Unsecured CredentialsMITRE ATLAS AML.T0083 Credentials from AI Agent Configuration

const DEFAULT_DOTENV_PATH = ".env.local";

What this means: Reads files or environment holding keys, tokens or sessions.

The rule's general advice: Confirm the tool needs this; otherwise do not install. (see the review note for this case)

Expected for what this tool does

The TypeScript SDK mirrors the Python one: it loads its settings and API keys from .env/.env.local in the project folder and saves keys you set with `--save=dotenv` to .env.local. This is the tool's documented configuration path; nothing sends the files elsewhere.

Reviewed by Claude (AI-assisted review), 2026-11-21

23 low-severity notes (informational, do not affect the result)

files.binary-unscanned: Binary files not analysed low

5 binary files not analysed; use --deep to run in the sandbox

What this means: Prebuilt executables cannot be read by static rules, so what they do is unknown until they run.

What you can do: Use --deep to run the package in the sandbox, or prefer packages built from source.

credential-access: Touches credentials or secrets low

deepeval/config/dotenv_handler.py:1

OWASP LLM LLM03 Supply ChainOWASP Agentic ASI03 Identity and Privilege AbuseOWASP Agentic ASI04 Agentic Supply Chain VulnerabilitiesMITRE ATLAS AML.T0055 Unsecured CredentialsMITRE ATLAS AML.T0083 Credentials from AI Agent Configuration

from dotenv import set_key, unset_key

What this means: Reads files or environment holding keys, tokens or sessions.

The rule's general advice: Confirm the tool needs this; otherwise do not install. (see the review note for this case)

Expected for what this tool does

deepeval's CLI and settings code load provider API keys from .env, .env.<APP_ENV> and .env.local in your project folder, and `--save=dotenv` writes keys you type into .env.local (file mode 0600). Most flagged lines are help text. Keys are used only to call the LLM providers you configure; nothing sends them elsewhere.

Reviewed by Claude (AI-assisted review), 2026-11-21

credential-access: Touches credentials or secrets low

deepeval/config/utils.py:4

OWASP LLM LLM03 Supply ChainOWASP Agentic ASI03 Identity and Privilege AbuseOWASP Agentic ASI04 Agentic Supply Chain VulnerabilitiesMITRE ATLAS AML.T0055 Unsecured CredentialsMITRE ATLAS AML.T0083 Credentials from AI Agent Configuration

from dotenv import dotenv_values

What this means: Reads files or environment holding keys, tokens or sessions.

The rule's general advice: Confirm the tool needs this; otherwise do not install. (see the review note for this case)

Expected for what this tool does

deepeval's CLI and settings code load provider API keys from .env, .env.<APP_ENV> and .env.local in your project folder, and `--save=dotenv` writes keys you type into .env.local (file mode 0600). Most flagged lines are help text. Keys are used only to call the LLM providers you configure; nothing sends them elsewhere.

Reviewed by Claude (AI-assisted review), 2026-11-21

credential-access: Touches credentials or secrets low

examples/mcp_evaluation/mcp_eval_multi_turn.py:7

OWASP LLM LLM03 Supply ChainOWASP Agentic ASI03 Identity and Privilege AbuseOWASP Agentic ASI04 Agentic Supply Chain VulnerabilitiesMITRE ATLAS AML.T0055 Unsecured CredentialsMITRE ATLAS AML.T0083 Credentials from AI Agent Configuration

from dotenv import load_dotenv

What this means: Reads files or environment holding keys, tokens or sessions.

What you can do: Confirm the tool needs this; otherwise do not install.

credential-access: Touches credentials or secrets low

examples/mcp_evaluation/mcp_eval_single_turn.py:7

OWASP LLM LLM03 Supply ChainOWASP Agentic ASI03 Identity and Privilege AbuseOWASP Agentic ASI04 Agentic Supply Chain VulnerabilitiesMITRE ATLAS AML.T0055 Unsecured CredentialsMITRE ATLAS AML.T0083 Credentials from AI Agent Configuration

from dotenv import load_dotenv

What this means: Reads files or environment holding keys, tokens or sessions.

What you can do: Confirm the tool needs this; otherwise do not install.

credential-access: Touches credentials or secrets low

typescript/test/test-confident/annotation.test.ts:1

OWASP LLM LLM03 Supply ChainOWASP Agentic ASI03 Identity and Privilege AbuseOWASP Agentic ASI04 Agentic Supply Chain VulnerabilitiesMITRE ATLAS AML.T0055 Unsecured CredentialsMITRE ATLAS AML.T0083 Credentials from AI Agent Configuration

import { config } from "dotenv";

What this means: Reads files or environment holding keys, tokens or sessions.

What you can do: Confirm the tool needs this; otherwise do not install.

credential-access: Touches credentials or secrets low

typescript/test/test-confident/dataset.test.ts:1

OWASP LLM LLM03 Supply ChainOWASP Agentic ASI03 Identity and Privilege AbuseOWASP Agentic ASI04 Agentic Supply Chain VulnerabilitiesMITRE ATLAS AML.T0055 Unsecured CredentialsMITRE ATLAS AML.T0083 Credentials from AI Agent Configuration

import { config } from "dotenv";

What this means: Reads files or environment holding keys, tokens or sessions.

What you can do: Confirm the tool needs this; otherwise do not install.

credential-access: Touches credentials or secrets low

typescript/test/test-confident/prompt.test.ts:1

OWASP LLM LLM03 Supply ChainOWASP Agentic ASI03 Identity and Privilege AbuseOWASP Agentic ASI04 Agentic Supply Chain VulnerabilitiesMITRE ATLAS AML.T0055 Unsecured CredentialsMITRE ATLAS AML.T0083 Credentials from AI Agent Configuration

import { config } from "dotenv";

What this means: Reads files or environment holding keys, tokens or sessions.

What you can do: Confirm the tool needs this; otherwise do not install.

credential-access: Touches credentials or secrets low

typescript/test/test-core/dataset.test.ts:4

OWASP LLM LLM03 Supply ChainOWASP Agentic ASI03 Identity and Privilege AbuseOWASP Agentic ASI04 Agentic Supply Chain VulnerabilitiesMITRE ATLAS AML.T0055 Unsecured CredentialsMITRE ATLAS AML.T0083 Credentials from AI Agent Configuration

import { config } from "dotenv";

What this means: Reads files or environment holding keys, tokens or sessions.

What you can do: Confirm the tool needs this; otherwise do not install.

credential-access: Touches credentials or secrets low

typescript/test/test-core/tracing.test.ts:1

OWASP LLM LLM03 Supply ChainOWASP Agentic ASI03 Identity and Privilege AbuseOWASP Agentic ASI04 Agentic Supply Chain VulnerabilitiesMITRE ATLAS AML.T0055 Unsecured CredentialsMITRE ATLAS AML.T0083 Credentials from AI Agent Configuration

import { config } from "dotenv";

What this means: Reads files or environment holding keys, tokens or sessions.

What you can do: Confirm the tool needs this; otherwise do not install.

Dispute this result

Maintainer and think this is wrong? Open a dispute on GitHub with the target id plugin-confident-ai-deepeval-20b089.