CluedIn.Crawling.HubSpot

CluedIn crawler for HubSpot.

---

Overview

This repository contains the code and associated tests for the HubSpot crawler.

Usage

NuGet Packages

To use the HubSpot crawler and provider with the CluedIn server you will have to add the following NuGet packages to the Providers.csproj project file:

Install-Package CluedIn.Crawling.HubSpot

Install-Package CluedIn.Crawling.HubSpot.Core

Install-Package CluedIn.Crawling.HubSpot.Infrastructure

Install-Package CluedIn.Provider.HubSpot

The NuGet packages specified are available on the internal development feed.

Debugging

To debug the HubSpot Provider/Crawler:

• Clone the CluedIn.Crawling.HubSpot repository
• Open Crawling.HubSpot.sln in Visual Studio
• Rebuild All
• Copy DLL and PDB files from \**\bin\debug\net452 to the servers ServerComponents folder
• Run CluedIn backend server using .\build.ps1 run
• In Visual Studio with the HubSpot crawler solution open, use Debug -> Attach to Process on CluedIn.Server.ConsoleHostv2.exe
• In the UI, add a new configuration for the HubSpot provider and invoke Re-Crawl

Working with the Code

Load Crawling.HubSpot.sln in Visual Studio or your preferred development IDE.

Running Tests

A mocked environment is required to run integration and acceptance tests. The mocked environment can be built and run using the following Docker command:

docker-compose up --build -d

Use the following commands to run all Unit and Integration tests within the repository:

dotnet test .\Crawling.HubSpot.sln --filter Unit
dotnet test .\Crawling.HubSpot.sln --filter Integration

To run Pester acceptance tests

invoke-pester

To review the WireMock HTTP proxy logs

docker-compose logs wiremock

References

• HubSpot

Tooling

• Docker
• Pester
• WireMock

About CluedIn

CluedIn is the Cloud-native Master Data Management Platform that brings data teams together enabling them to deliver the foundation of high-quality, trusted data that empowers everyone to make a difference.

We're different because we use enhanced data management techniques like Graph and Zero Upfront Modelling to accelerate the time taken to prepare data to deliver insight by as much as 80%. Installed in as little as 20 minutes from the Azure Marketplace, CluedIn is fully integrated with Microsoft Purview and the full Microsoft Fabric suite, making it the preferred choice for Azure customers.

To learn more about CluedIn, contact the team today.

https://www.cluedin.com