Web Developer - Web Scraping and WordPress Integration Specialist
We are seeking an experienced web developer to create and maintain an automated system for scraping car listings from a third-party website and importing them into our WordPress-based automotive marketplace.
## Key Responsibilities:
- Develop a robust web scraping script to extract car listing data from a specified automotive website - Create an automated process to run the scraping script nightly - Implement logic to identify and remove duplicate listings - Build a WordPress integration to automatically import scraped data into our website - Ensure the entire process runs seamlessly without manual intervention
## Required Skills and Experience:
- Extensive experience with web scraping techniques and tools (e.g., Python with BeautifulSoup or Scrapy) - Strong knowledge of WordPress development, including custom post types and the WordPress REST API - Proficiency in PHP and JavaScript - Familiarity with task scheduling in Linux environments (e.g., cron jobs) - Experience with database management, particularly MySQL - Solid understanding of HTML and CSS for parsing web content - Knowledge of ethical web scraping practices and robots.txt protocols
The ideal candidate will be able to create a seamless, automated workflow that reliably updates our WordPress site with fresh, de-duplicated car listings on a nightly basis. This role requires a blend of technical expertise in web scraping, WordPress development, and system automation.
Michigan Commercial Owners Lead Generation Category: Data Analysis, Data Collection, Data Entry, Data Management, Data Processing, Excel, Lead Generation, Web Search Budget: $30 - $250 USD
Accurate Copy-Paste Data Entry Category: Copy Typing, Data Entry, Editing, Excel, Microsoft Office, Proofreading, Typing, Word Budget: ₹750 - ₹1250 INR
Bring Paying Web-Dev Clients Category: AI Development, Internet Marketing, Lead Generation, Marketing, Mobile App Development, Sales, SEO, Social Media Marketing Budget: $250 - $750 USD