1001 Freelance Projects
Latest Projects from Freelance Marketplaces
Today is: 28-Jun-2025 07:00 GMT
View Project
View this project in detail (Note: you will be redirected to external marketplace)
Project title: serpapi scholar ai websearch equviliant
Posted by: External project from PeoplePerHour
Started: 25-Mar-2025 18:40 GMT
Description: Original Project Overview
We maintain a Google Sheets database of academic figures, each with the following columns:

Name
Surname
Email
University
Subject

We need to automatically fetch the latest two publications for each individual using:
Google Scholar (via SerpAPI’s Scholar API)
ORCID (public API)
OpenAlex (public API)

The results must be inserted back into specified columns in the Google Sheet (F–Q), updated daily or on-demand.

Key Challenges
Sorting by Latest in Google Scholar
By default, Scholar returns top-cited or most-relevant articles, not necessarily newest.
Must force a date sort (&sort=pubdate) or a separate fallback approach.
Handling Ambiguous Names
Multiple authors can share the same name.
Potentially need to detect and filter out mismatched results.
Ensuring Valid Data Types
Google Sheets rejects structured or non-string data.
Must parse out just the string or numeric year/date.
Rate Limits and API Keys
Respect daily or per-minute call limits for SerpAPI, ORCID, OpenAlex.
Must handle errors gracefully.

Automation
Should run as a script from a server or cloud environment (we have console access).
Possibly on a schedule (e.g., daily cron job).

Responsibilities
Set up a robust Python script or application that:
Authenticates to Google Sheets (using service account credentials). DONE
Retrieves our researcher data (Name, Surname, Email, University, Subject) from the “Pubs” or “Topics” sheet.
Calls SerpAPI’s Google Scholar endpoint with date-sorted queries, including fallback logic if no results appear.
Calls ORCID’s public API (optional, can parse structured date fields carefully).
Calls OpenAlex’s public API to fetch the newest two works by each author.
Inserts the results (title, year/date) back into the correct columns in the Google Sheet (F–Q).
Handle name disambiguation or minimal validation so we don’t store obviously incorrect publications.

Deliverables
Python script (or small app) that can be triggered manually or on a schedule.
Successful write-back of 2 publications each from Google Scholar, ORCID, and OpenAlex (6 total) into the correct columns.
Error handling: If no results, store “N/A” or a sensible fallback.
Instructions on setup, environment variables, and usage (e.g., README).




What Still Needs To Be Done
1. Fix Google Scholar Fetch
Main Problem: You're getting most cited or incorrect results.

Needs Fixing:

Ensure sort=pubdate is actually respected in SerpAPI query.

Add fallback logic: if pubdate query fails (returns nothing), retry without it.

Clean up irrelevant results using basic validation (e.g., check university or subject in result string).

2. OpenAlex Improvements
Currently works for some authors.
But still needs name disambiguation logic:

Validate author’s affiliation or match on email (if possible).

Fallback if OpenAlex returns wrong author.

3. ORCID Integration (Optional)
You paused this due to structured date errors.

If you want to include it again later:

Parse structured publication-date fields into simple strings.

Validate the correct ORCID author before fetching works.

4. Error Handling
Improve logging to show:

Which step failed (e.g. API call, parsing, writing to sheet).

Show why (e.g., "no publications found", "mismatched data", "bad year format").

Replace all "N/A" logic with something more transparent (e.g., "No match found for [X]").

5. Name Disambiguation Logic
Currently just using Name + University + Subject in the query.

Needs:

Smarter matching logic to avoid irrelevant or repetitive publications.

Maybe strip long names or fuzzy-match affiliations if exact match fails.

6. Cleaner Sheet Writes
Fix Google Sheets writing errors:

Avoid trying to write structured JSON (like ORCID publication-date objects).

Ensure all fields written are flat strings (title + year/date only).

7. Automation (Optional)
Set up to run automatically (cron job, server scheduler) if needed.

Add logging/output to file for record-keeping.
Project ID: 3427941
Project category:
Project budget:
View this project in detail (Note: you will be redirected to external marketplace)
Last Projects / Browse Projects
  Project Started
Booking Automation Specialist Needed
Category: Java, JavaScript, Mobile App Development, PHP, Software Architecture
Budget: €1500 - €3000 EUR
28-Jun-2025
04:04 GMT
Consulting Website Redesign wordpress
Category: Graphic Design, HTML, PHP, Web Design, WordPress
Budget: $30 - $250 USD
28-Jun-2025
04:04 GMT
Instagram Content Creation Specialist
Category: Content Writing, Copywriting, Ghostwriting, Social Media Marketing, Twitter
Budget: ₹600 - ₹1500 INR
28-Jun-2025
04:03 GMT
Modern Minimalistic Animated Birthday Invite
Category: 3D Animation, After Effects, Animation, Graphic Design, Motion Graphics
Budget: ₹1500 - ₹12500 INR
28-Jun-2025
04:02 GMT
Trendy Instagram Video Editor
Category: After Effects, Video Editing, Video Production, Video Services, Videography
Budget: ₹600 - ₹1500 INR
28-Jun-2025
04:01 GMT
WordPress Site for Law Journals
Category: Graphic Design, HTML, PHP, Web Design, WordPress
Budget: ₹1500 - ₹12500 INR
28-Jun-2025
04:00 GMT
Port Python Video Streaming Logic to Kotlin (with Cache/Buffer & FFmpeg/HLS/DASH Expertise)
Category: Algorithm, Java, Kotlin, Python, Video Services, XML
Budget: ₹12500 - ₹37500 INR
28-Jun-2025
03:59 GMT
WordPress Gardening Blog Development
Category: Graphic Design, HTML, PHP, Web Design, WordPress
Budget: ₹1500 - ₹12500 INR
28-Jun-2025
03:57 GMT
Flutter Bug Fix Expert Needed
Category: Android, Flutter, Mobile App Development
Budget: ₹600 - ₹1500 INR
28-Jun-2025
03:54 GMT
Sales-Boosting Digital Marketing
Category: Advertising, Facebook Marketing, Internet Marketing, Leads, Marketing, Sales, Search Engine Marketing (SEM), SEO, Social Media Marketing, Social Networking
Budget: ₹12500 - ₹37500 INR
28-Jun-2025
03:54 GMT
User Input Validation Tool
Category: Java, JavaScript, MySQL, PHP, Software Architecture, Web Hosting
Budget: $2 - $8 USD
28-Jun-2025
03:52 GMT
Educational Video Editing for Social Media
Category: After Effects, Editing, Graphic Design, Photoshop, Video Editing, Video Production, Video Services, Videography
Budget: ₹1500 - ₹12500 INR
28-Jun-2025
03:47 GMT
Elegant Animated Birthday Invitation
Category: 3D Animation, After Effects, Animation, Graphic Design, Motion Graphics
Budget: $30 - $250 USD
28-Jun-2025
03:46 GMT
Custom Pine Script Dashboards
Category: HTML, HTML5, JavaScript, PHP, Software Architecture
Budget: ₹1500 - ₹12500 INR
28-Jun-2025
03:45 GMT
PCB Design for 3-Phase Current Monitoring
Category: Circuit Design, Electrical Engineering, Electronics, Microcontroller, PCB Layout
Budget: ₹1500 - ₹12500 INR
28-Jun-2025
03:45 GMT
Browse All Projects
Projects by Skills ...
Projects for 'android'
Projects for 'ajax'
Projects for 'asp'
Projects for 'aspnet'
Projects for 'cms'
Projects for 'cpp'
Projects for 'csharp'
Projects for 'css'
Projects for 'delphi'
Projects for 'design'
Projects for 'drupal'
Projects for 'excel'
Projects for 'facebook'
Projects for 'flash'
Projects for 'html'
Projects for 'java'
Projects for 'javascript'
Projects for 'joomla'
Projects for 'iphone'
Projects for 'mysql'
Projects for 'photoshop'
Projects for 'php'
Projects for 'python'
Projects for 'ruby'
Projects for 'seo'
Projects for 'sql'
Projects for 'sysadm'
Projects for 'translate'
Projects for 'typing'
Projects for 'twitter'
Projects for 'vbnet'
Projects for 'xml'
Projects for 'wordpress'
Projects for 'writing'
Read RSS feeds ... New!
RSS feed for 'android'
RSS feed for 'ajax'
RSS feed for 'asp'
RSS feed for 'aspnet'
RSS feed for 'cms'
RSS feed for 'cpp'
RSS feed for 'csharp'
RSS feed for 'css'
RSS feed for 'delphi'
RSS feed for 'design'
RSS feed for 'drupal'
RSS feed for 'excel'
RSS feed for 'facebook'
RSS feed for 'flash'
RSS feed for 'html'
RSS feed for 'java'
RSS feed for 'javascript'
RSS feed for 'joomla'
RSS feed for 'iphone'
RSS feed for 'mysql'
RSS feed for 'photoshop'
RSS feed for 'php'
RSS feed for 'python'
RSS feed for 'ruby'
RSS feed for 'seo'
RSS feed for 'sql'
RSS feed for 'sysadm'
RSS feed for 'translate'
RSS feed for 'typing'
RSS feed for 'twitter'
RSS feed for 'vbnet'
RSS feed for 'xml'
RSS feed for 'wordpress'
RSS feed for 'writing'
New!
Проекты на русском
(Projects in Russian)

Short URL:
1001fp.com
Mobile version:
m.1001freelanceprojects.com
Copyright © 2005-2024 1001 Freelance Projects