Deduplicate Scraping AI Grants for Eligibility using AI

## Try It Out!

### This n8n templates demonstrates how to automatically ingest a source of leads at regular intervals and take advantage of n8n's remove duplicates node to simplify duplicate detection.
Additionally after the leads are captured, a simple alerts notification can be generated and shared with team members.

### How it works
* A scheduled trigger is set to fetch a list of AI grants listed on the grants.gov website in the past day.
* A Remove Duplicates node is used to track Grant IDs to filter out those already processed by the workflow.
* New grants are summarized and analysed by AI nodes to determine eligibility and interest which is then saved to an Airtable database.
* Another scheduled trigger starts a little later than the first to collect and summarize the new grants
* The results are then compiled into an email template using the HTML node, in the form of a newsletter designed to alert and brief team members of new AI grants.
* This email is then sent to a list of subscribers using the gmail node.

## How to use
* Make a copy of sample Airtable here: https://airtable.com/appiNoPRvhJxz9crl/shrRdP6zstgsxjDKL
* The filters for fetching the grants is currently set to the "AI" category. Feel free to change this to include more categories.
* Not interested in grants, this template can works for other sources of leads just change the endpoint and how you're defining the item ID to track.


### Need Help?
Join the [Discord](https://discord.com/invite/XPKeKXeB7d) or ask in the [Forum](https://community.n8n.io/)!

Happy Hacking!