Commit Graph

31 Commits

Author SHA1 Message Date
896216860f ES|QL: Object API helper (#2238)
* ESQL toRecord helper

* ESQL helper tests

* Add ESQL object API helper to client meta header

* Add docstring for toRecords

* Include column metadata in toRecords helper

* Add docs for ESQL toRecords helper

* Verify columns in helper return object
2024-05-06 12:30:47 -05:00
4aa00e03e1 onSuccess function for bulk helper (#2199)
* Bulk helper onSuccess callback

For https://github.com/elastic/elasticsearch-js/issues/2090

Includes refactor of the tryBulk result processing code, to make
iterating over bulk response data easier to understand.

* Add onSuccess tests for each datasource type

* Cleanup, additional comments

* Add documentation for onSuccess callback

* Update changelog

* Drop link to 8.14 release notes.

Page not yet published, breaking docs build.
2024-04-02 14:38:09 -05:00
1607a0d3f7 Fix hang in bulk helper semaphore when server responses are slower than flushInterval (#2027)
* Set version to 8.10.1

* Add tests for bulk helper with various flush and server timeouts

* Copy and empty bulkBody when flushBytes is reached

Before it was waiting until after semaphore resolved, then sending with
a reference to bulkBody. If flushInterval is reached after `await
semaphore()` but before `send(bulkBody)`, onFlushTimeout is "stealing"
bulkBody so that there is nothing left in bulkBody for the flushBytes
block to send, causing an indefinite hang for a promise that does not
resolve.

* comment typo fixes

---------

Co-authored-by: Quentin Pradet <quentin.pradet@elastic.co>
2024-02-06 09:58:21 +04:00
426919709f Throw an explicit error when asStream is used with bulk helper (#2078) 2023-11-16 10:14:20 -06:00
6b4cdee53c Allow document to be overwritten in onDocument iteratee of bulk helper (#1732)
Co-authored-by: Josh Mock <joshua.mock@elastic.co>
2023-07-20 14:33:46 -05:00
a2b5e66a46 Add test to verify bulk helper index drift fix (#1912) 2023-06-12 16:03:11 -05:00
dbfc8fc4d1 Propagate bulk helper document generic (#1606) 2021-12-16 16:45:48 +01:00
529742ac1f Updated test 2021-10-25 09:38:16 +02:00
4cf1fc6cd4 Updated test 2021-10-21 09:53:24 +02:00
4492532727 Update unknown parameter handling. (#1568) 2021-10-18 16:01:55 +02:00
1a227459f0 Elasticsearch v8 (#1558) 2021-09-30 09:45:04 +02:00
17c744ed80 Verify connection to Elasticsearch (#1487) 2021-07-19 16:42:04 +02:00
f2d8cf7d34 Bulk update improvements (#1428) 2021-07-12 16:04:29 +02:00
c64152b9b3 Drop node v10 support (#1471) 2021-05-20 16:16:45 +02:00
ab5d8997b8 Remove Node.js v8 support (#1402) 2021-02-19 08:27:20 +01:00
973a98180a [helpers] add support for transport options to all helpers (#1400)
Co-authored-by: spalger <spalger@users.noreply.github.com>
2021-02-18 16:33:08 +01:00
618b244473 Prereleases in meta header should be displayed as p (#1381) 2021-01-19 08:10:27 +01:00
61eee69424 Added x-elastic-client-meta header (#1373) 2020-12-16 10:42:26 +01:00
ea009da3b6 Scroll search should clear the scroll at the end (#1331) 2020-10-12 10:46:51 +02:00
858616d6c6 Helper param fix (#1284)
Co-authored-by: Tomas Della Vedova <delvedor@users.noreply.github.com>
2020-09-01 12:15:11 +02:00
51ab5b0b00 Updated license header (master) (#1266) 2020-07-23 12:26:56 +02:00
b4d0dc87d3 Reorganized test and force 100% code coverage (#1226) 2020-06-15 08:37:04 +02:00
04d082cb49 Helpers: avoid allocating new timers (#1224) 2020-06-12 10:43:41 +02:00
7dfaa6c5b4 Improve helper concurrency (#1214) 2020-06-04 10:55:51 +02:00
80817a00f9 Added timeout support in bulk and msearch helpers (#1206) 2020-06-03 10:33:08 +02:00
1a25b623b0 Add multi search helper (#1186) 2020-05-25 15:37:01 +02:00
84217fc737 Use filter_path for improving the search helpers performances (#1199) 2020-05-25 14:25:32 +02:00
191b8fb9fb Force lowercase in all headers (#1187) 2020-05-14 16:10:18 +02:00
df17fb99d0 Added async generator support in bulk helper (#1138)
* Added async generator support in bulk helper

* Updated test

* Updated docs

* Improved type definitions

* Updated onDrop callback type definition
2020-04-03 09:46:26 +02:00
85616b07ef Improve code coverage (#1124)
* Helpers: Fixed stats counting

* Improve code coverage
2020-03-24 12:27:05 +01:00
d7836a16af Client helpers (#1107)
* Added client helpers

* Updated test

* The search helper should return only the documents

* Added code comments

* Fixed bug

* Updated test

* Removed bulkSize and added flushBytes

* Updated test

* Added concurrency

* Updated test

* Added support for 429 handling in the scroll search helper

* Updated test

* Updated stats count

* Updated test

* Fix test

* Use client maxRetries as default

* Updated type definitions

* Refactored bulk helper to be more consistent with the client api

* Updated test

* Improved error handling, added refreshOnCompletion option and forward additinal options to the bulk api

* Updated type definitions

* Updated test

* Fixed test on Node v8

* Updated test

* Added TODO

* Updated docs

* Added Node v8 note

* Updated scripts

* Removed useless files

* Added helpers to integration test

* Fix cli argument position

* Moar fixes

* Test run elasticsearch in github actions

* Use master action version

* Add vm.max_map_count step

* Test new action setup

* Added Configure sysctl limits step

* Updated action to latest version

* Don't run helpers integration test in jenkins

* Run helpers integratino test also with Node v10

* Updated docs

* Updated docs

* Updated helpers type definitions

* Added test for helpers type definitions

* Added license header
2020-03-23 17:43:10 +01:00