Analyzing Project Insights and Metrics

Synthesis provides a powerful suite of analytical tools and visualizations designed to give you a clear, data-driven understanding of your research projects. From high-level overviews of your entire workspace to detailed insights into individual projects, these metrics empower you to track progress, assess quality, and identify key findings as your research evolves.

The Synthesis Analytics Ecosystem

You can access project insights at two primary levels:

Dashboard Overview: Upon launching Synthesis, the main dashboard provides an aggregated view of your entire research portfolio. Here, you'll find summary statistics and trends across all your projects.
Project Details View: For a deeper dive, navigate into any specific project. Within the project's dedicated view, you'll find granular metrics and visualizations tailored to that project's content and progress.

Synthesis leverages its AI agents and your uploaded documents to automatically generate these insights, helping you stay informed without manual data compilation.

Core Analytical Categories

Synthesis organizes its insights into several key categories, each offering a unique perspective on your research.

1. Project Health and Progress

At a glance, understand the scale and status of your work:

Total Projects: The cumulative count of all active research projects within your Synthesis workspace.
Total Documents: The combined number of documents uploaded and processed across all projects, giving you a sense of your data volume.
Completeness: A project-specific metric indicating the overall progress of an individual project, represented as a percentage. This helps you track how much of the defined research scope has been addressed by the AI pipeline.

2. Quality Assessment

Synthesis goes beyond simple progress tracking to evaluate the intellectual quality of your research. These project-specific metrics are derived from the hypotheses generated by the AI and the overall project development:

Novelty: Reflects the originality and uniqueness of the ideas and hypotheses within your project. A higher novelty score suggests more innovative and less explored research avenues.
Cohesion: Indicates the thematic consistency and logical interconnectedness of concepts and arguments within your research. (Internally, this is often derived from the feasibility of your hypotheses, reflecting how well ideas fit together.) A higher score implies a well-structured and focused research narrative.
Redundancy: Measures the inverse of diversity or distinctiveness in your research approach. (Internally, this is mapped from 100 - Testability). A lower redundancy score (implying higher testability or variety) suggests a broader exploration of different angles and robust, distinct hypotheses.
Overall Quality Score: An average of the key quality dimensions (Novelty, Cohesion, Redundancy), providing a single, synthetic score for the project's intellectual rigor.

These metrics are typically visualized in a Quality Metrics Chart (e.g., a radar chart), allowing for easy comparison and identification of strengths and areas for improvement.

3. Knowledge Discovery and Structuring

Understand the conceptual landscape of your research:

Concept Network: An interactive graph visualization that displays key concepts extracted from your documents and their relationships.
- Nodes: Represent individual concepts (e.g., "AI Ethics," "Machine Learning"). Their size often correlates with their importance within the project.
- Edges: Show connections between concepts.
- Clusters: Concepts are grouped into clusters, often visually indicated by color, to highlight dominant themes and sub-topics. This helps identify central themes and potential unexplored areas.
Topic Cluster Heatmap: (Available in project details) Provides a visual representation of how different concepts cluster together, offering a deeper understanding of the thematic organization of your research and the density of related ideas.
Hypothesis Management: Within each project, you can view and manage a table of all generated hypotheses, each accompanied by individual scores for Novelty, Feasibility, and Testability. These scores are crucial inputs to the project's overall Quality Metrics.

4. Research Development Trends

Track the evolution of your content and its impact:

Word Count Trend: This chart visualizes the estimated growth of your research content over time, derived from the total word count of uploaded documents. It helps you monitor your content generation velocity and identify periods of significant activity.
```
[
  { "name": "Jan", "words": 15000 },
  { "name": "Feb", "words": 32000 },
  { "name": "Mar", "words": 58000 }
]
```
Citation Data (Future/Mocked): While currently a placeholder, Synthesis is designed to track and visualize citation patterns over time. This metric will eventually help you understand the influence of your work, identify key references, and contextualize your research within the broader academic landscape.

5. Agent Performance and Activity

Synthesis is powered by intelligent AI agents. Transparency into their operations is crucial:

Agent Activity Feed: A chronological log of all AI agent operations performed for a project. This feed shows you which agents (outliner, writer, presenter, etc.) have run, their status (e.g., completed, processing, error), and their createdAt and completedAt timestamps. This allows you to monitor the pipeline's progress in real-time.
Agent Performance Metrics: Provides insights into the efficiency and output quality of individual agents over time, helping you understand their contribution to your project's development. This can include metrics on run duration, output size, and success rates.

Accessing Project Insights

From the Dashboard:
- When you first load Synthesis, the main dashboard (/) automatically displays aggregated metrics like Total Projects, Total Documents, and an Average Quality score across all your work.
- Summary charts like the Quality Metrics Chart, Word Count Trend, and Citation Chart (if available) also provide an overview.
For a Specific Project:
- Click on any Project Card from the dashboard.
- This action will take you to the Project Details View.
- Within the Project Details, navigate through the tabs (e.g., "Overview," "Insights," "Analytics") to find dedicated visualizations and tables for:
  - Quality Metrics Chart
  - Concept Network
  - Word Count Trend
  - Hypothesis Table
  - Agent Activity Feed
  - Project Insights (a summary of key findings)
  - Agent Performance Metrics

By actively engaging with these analytical tools, you can gain deeper insights into your research, make informed decisions, and streamline your path to impactful discoveries.