We have a real-time ETL pipeline for **Claude Code conversations** that:
* **Extracts** log data in real time * **Transforms** it into structured events (timestamps, session metadata, tagging) * **Loads** it into **QuestDB** for analytics and monitoring
The current pipeline works but needs an expert to bring **data engineering best practices** — ensuring **reliability, observability, correctness, and performance** for production use.
Install the **AI Agent Host** along with the provided scripts and **Claude Code** under your own subscription. After reviewing the system and checking existing issues, send us a **detailed milestone budget** based on your findings.
* **Python 3** with ETL/data engineering expertise * Experience with **real-time streaming systems** (QuestDB, Kafka, Pulsar, etc.) * Familiarity with **ILP ingestion**, **batching**, **retries**, **data contracts** * Knowledge of **logging, monitoring, and delivery guarantees** * Basic Docker knowledge for local & production environments
---
## **Budget & Timeline**
* **Milestone 1 (Debugging):** * **Milestone 2 (Enterprise Upgrade):** * Budget: **Open to proposals after reviewing the repository**
---
## **How to Apply**
Please include:
1. Real-time ETL/data pipeline projects you’ve built or hardened 2. Your approach for ensuring **data quality, ordering, and reliability** 3. Estimated **timeline & cost** per milestone after installing and reviewing the repository.
App Promo Reels Creation Category: A / V Editing, Adobe Premiere Pro, Animation, Facebook Marketing, Social Media Marketing, Twitter, Video Editing, Video Production Budget: ₹600 - ₹1500 INR
02-Sep-2025 10:04 GMT
Wikipedia Bio & Evolution Article Category: Academic Writing, Article Rewriting, Article Writing, Copy Editing, Editing, Ghostwriting, Research, Research Writing Budget: $5000 - $10000 USD
02-Sep-2025 10:02 GMT
AI Travel Chatbot Prototype Category: AI Chatbot Development, Chatbot Integration, Data Modeling, Django, Flask, JavaScript, LLM Integration, Python, Web Scraping Budget: ₹12500 - ₹37500 INR
Commercial Agents in Greece (Home Textiles) Category: B2B Marketing, Business Development, Data Collection, Data Entry, Data Management, Google Sheets, Lead Generation, Market Research, Research, Web Search Budget: $30 - $250 USD
02-Sep-2025 09:52 GMT
Excel Resource Management Dashboard Category: Data Analysis, Data Management, Data Processing, Data Visualization, Excel, Project Management, Visual Basic, Visual Basic For Apps Budget: ₹1500 - ₹12500 INR
