Data Pipelines

Real-time social media data ingestion, processing, and storage using FastAPI and PostgreSQL.

Scheduler Status

Loading scheduler status...

Pipeline Metrics (Last 7 Days)

Loading metrics...

Pipeline Run History

Loading run history...

Pipeline Status

Loading status...

Recent Posts

Filter by sentiment:
Loading posts...

Technology Stack

Backend (FastAPI)

High-performance Python API with async support, automatic OpenAPI documentation, and data validation.

FastAPIPythonSQLAlchemy

Database

PostgreSQL with optimized schemas and indexes for efficient data storage and retrieval.

PostgreSQLRailway

Data Collection

Integration with Reddit API for real-time data collection with rate limiting and error handling.

Reddit APIPRAW

Deployment

Deployed on Railway with automatic builds from GitHub and zero-downtime deployments.

RailwayDockerGitHub Actions