v3.2.0
Latest
8 February 2025
SFTP Delivery & Performance Improvements
New delivery channel for corporate environments, Google Cloud Storage support, and significant latency improvements for JavaScript-heavy extractions.
- NewSFTP delivery method for corporate and enterprise environments. Configure credentials via the dashboard.
- NewGoogle Cloud Storage (
gcs) as delivery destination. Supports service account authentication.
- Improved~30% latency reduction on JavaScript-heavy page extraction through optimised Chromium resource loading.
- ImprovedBetter memory management on batch jobs processing 5,000+ URLs, reducing timeout frequency by ~60%.
- FixFixed timeout on long-running sessions that could cause premature job failure on complex pages.
- FixCorrected
Content-Type header on XML delivery responses (was returning application/json).
v3.1.0
15 January 2025
Cloudflare Turnstile & XML Schema Validation
Expanded CAPTCHA support and structured XML output for enterprise pipeline integration.
- NewAutomatic Cloudflare Turnstile CAPTCHA resolution. No configuration needed — detected and solved automatically.
- NewXML delivery with validatable XSD schema. Enable with
"format": "xml", "xml_schema": true.
- New
wait_for parameter: specify a CSS selector to wait for before extraction (requires render_js: true).
- ImprovedResidential proxy rotation in Asia-Pacific region. Added 2M+ new IPs in Japan, South Korea and Singapore.
- FixFixed edge case where
geo parameter was ignored when proxy_type was set to datacenter.
- SecurityAPI key rotation now invalidates old keys immediately (previously had a 5-minute grace period).
v3.0.0
Major
2 December 2024
API v3 — Complete Redesign
Major version release with new endpoint structure, webhook support, cloud delivery, and real-time consumption tracking. See the migration guide for upgrading from v2.
- BreakingNew endpoint structure under
/v3/. All v2 endpoints deprecated (sunset: 1 March 2025).
- BreakingAuthentication changed from query parameter to
Authorization: Bearer header.
- BreakingResponse envelope changed.
result field renamed to data. Error format standardised.
- NewWebhooks for job completion/failure notifications. Register via
POST /v3/webhooks.
- NewDirect delivery to Amazon S3 buckets. Configure credentials in the dashboard.
- NewPagination system for large datasets via
cursor parameter on /v3/jobs/{id}/data.
- NewReal-time consumption metrics panel at
GET /v3/usage.
- NewTest API keys (
crw_sk_test_...) with sandbox environment for development.
- NewCustom HTTP headers support via
headers parameter.
v2.5.0
10 October 2024
Scalability Improvements
Infrastructure upgrade enabling significantly higher throughput for enterprise workloads.
- NewAuto-scaling up to 50M+ daily requests. Multi-region distributed processing.
- ImprovedMemory optimisation on high-volume extractions. Batch jobs consuming ~40% less memory.
- ImprovedConnection pooling improvements reducing TCP overhead by ~25% on sequential requests.
- FixFixed rare race condition on concurrent batch jobs targeting the same domain.
v2.4.0
18 August 2024
hCaptcha Support & CSV Improvements
Extended CAPTCHA coverage and better CSV output handling.
- NewAutomatic hCaptcha resolution added to the CAPTCHA solving engine.
- ImprovedCSV output now properly escapes special characters and handles multi-line fields.
- ImprovedAdded
Accept-Language auto-detection based on geo parameter.
- FixFixed encoding issue on pages with mixed UTF-8 and Latin-1 content.
- Deprecated
api_key query parameter for authentication. Use Authorization: Bearer header instead. Will be removed in v3.
v2.3.0
5 June 2024
Residential Proxy Pool Expansion
Major proxy infrastructure upgrade with new regions and improved rotation algorithms.
- NewResidential proxy pool expanded to 40M+ IPs across 195+ geolocations.
- New
proxy_type parameter to choose between residential and datacenter pools.
- ImprovedSmarter session rotation algorithm that reduces IP blocks by ~35%.
- SecurityTLS 1.3 enforced on all API endpoints. TLS 1.2 connections now rejected.