ADBC Connections
FastTransfer 1.0 ships with the Arpe.io ADBC drivers. With an adbc_* connection type, the rows travel from the source to the target as Arrow columnar data, without any conversion to .NET objects in between. Nothing else to install: the drivers are bundled in the FastTransfer binary.
Connection Types
The same types are used for the source (--sourceconnectiontype) and the target (--targetconnectiontype).
adbc_mssqlADBCSQL Server, default port 1433
adbc_pgsqlADBCPostgreSQL, default port 5432
adbc_oracleADBCOracle, default port 1521
adbc_db2: Db2 for LUW, default port 50000
adbc_teradataADBCTeradata, default port 1025
adbc_netezzaADBCNetezza, default port 5480
Rules
- ADBC on both endsAn
adbc_*source goes with anadbc_*target. Mixing anadbc_*type with a native type is refused. - PlatformsWindows x64 and Linux x64. Not available on Linux ARM64.
- LicenseThe drivers need an ADBC driver block in the license file. See License.
Connecting
With the usual parameters
--sourceserver, --sourcedatabase, --sourceuser, --sourcepassword and --sourcetrusted (and their target equivalents) work as with the native types.
- Windows
- Linux
.\FastTransfer.exe `
--sourceconnectiontype "adbc_oracle" `
--sourceserver "oraserver:1521/ORCLPDB1" `
--sourceuser "TPCH" `
--sourcepassword "mypassword" `
--sourceschema "TPCH" `
--sourcetable "ORDERS" `
--targetconnectiontype "adbc_mssql" `
--targetserver "localhost" `
--targettrusted `
--targetdatabase "tpch" `
--targetschema "dbo" `
--targettable "orders" `
--parallelmethod "Physical" `
--degree 8 `
--loadmode "Truncate"
./FastTransfer \
--sourceconnectiontype "adbc_oracle" \
--sourceserver "oraserver:1521/ORCLPDB1" \
--sourceuser "TPCH" \
--sourcepassword "mypassword" \
--sourceschema "TPCH" \
--sourcetable "ORDERS" \
--targetconnectiontype "adbc_mssql" \
--targetserver "localhost" \
--targettrusted \
--targetdatabase "tpch" \
--targetschema "dbo" \
--targettable "orders" \
--parallelmethod "Physical" \
--degree 8 \
--loadmode "Truncate"
--sourceserver/--targetserverhost, host:port or host,port. SQL Server named instance: host\INSTANCE. Oracle: host:port/service or a TNS alias.
--sourcetrusted/--targettrustedWindows (SSPI) or Kerberos for SQL Server and PostgreSQL; Kerberos for Oracle, Db2 and Teradata. Not available for Netezza.
With a connection string
--sourceconnectstring and --targetconnectstring take a uri= in the driver's format:
- SQL Server
- PostgreSQL
- Oracle
- Db2
- Teradata
- Netezza
uri=sqlserver://user:password@host:1433/?database=tpch
uri=postgresql://user:password@host:5432/tpch
uri=oracle://user:password@host:1521/orclpdb1
uri=db2://user:password@host:50000/TPCH
uri=teradata://user:password@host/SALES
uri=netezza://user:password@host:5480/system
- Special characters in a password must be percent-encoded:
@→%40,:→%3A,/→%2F. - SQL Server or PostgreSQL .NET keywords (
Data Source=,Trusted_Connection=Yes, ...) are not understood here: use the usual parameters or auri=.
Target Table
As with the native targets, the target table must exist: FastTransfer does not create it.
The schema and table names are used exactly as typed, case included. Use the name as the database stores it: usually ORDERS on Oracle, Db2 and Teradata, orders on PostgreSQL. If the table is not found, FastTransfer stops before truncating or loading anything.
Parallel Methods
All the parallel methods work with ADBC sources:
Physicaladbc_mssql, adbc_pgsql, adbc_oracle, adbc_netezza
DBPartitionadbc_mssql, adbc_pgsql, adbc_oracle, adbc_teradata, adbc_db2
RangeId,Ntile,Random,DataDriven,TimepartitionAll ADBC sources
See Parallel Parameters.
License
The ADBC drivers need an ADBC driver block in addition to the FastTransfer block. Both blocks can be in the same license file: FastTransfer passes the ADBC block to the drivers, and nothing else is needed.
Without an ADBC driver block, an adbc_* transfer stops with exit code 99. Contact Arpe.io to add it to your license.
Differences with the Native Types
--useworktablesNot availableThe parallel streams load the target table directly.
--batchsizeIgnoredA warning is logged: the drivers size their own batches.
Time zonesSQL Server datetimeoffset and Oracle TIMESTAMP WITH TIME ZONE values arrive as the same instant in UTC.
Driver messagesWritten to the FastTransfer log, with the connection type as label.
- Source Connection Parametersall the source connection types
- Target Connection Parametersall the target connection types
- Licensethe license file and its blocks