I'm trying to create profile/summary pages of companies and people, and I need a way to pull select info from social media sites, RSS feeds, and static websites into one unified stream.
This stream will include (what we are collecting):
- Title (linked to the source)
- Image (linked to the source)
- Intro text (limited to 150 characters)
- Publish/update date
The tool we use will ideally:
- Allow for customizing what we pull per source, possibly via a visual selector tool (chrome extension?). There will be a limited number of sites we parse, so we may be able to create repeatable rules per source, but would need to be notified if those rules break.
- Be able to use sessions/cookies to log in to password-protected pages
- Optionally filter what we collect based on keyword presence
- Store this data so that we can call it into another website as an RSS/XML feed
I'm open to using an existing plugin, open-source project, etc to help speed up the project, and the first leg of this journey is to brainstorm solutions with someone that has experience in this area and that can help build/customize the path we land on.
Please address your experience in this area and any initial ideas as part of your response.
Hourly Range: $20.00-$45.00
Posted On: December 27, 2021 23:25 UTC Category: Scripting & Automation Skills:PHP, JavaScript, WordPress, Data Scraping
Skills: PHP, JavaScript, WordPress, Data Scraping Country: United States
