Device Sync Overview
Device Sync Overview: Automated Network Device Inventory Management in rConfig V8
Section titled “Device Sync Overview: Automated Network Device Inventory Management in rConfig V8”Device Sync enables automated synchronization of network device inventory from upstream monitoring and management platforms into rConfig V8. Instead of manually entering device information, Device Sync extracts device data from systems like Zabbix, Nautobot, and NetBox, transforms it to rConfig format, and imports it into a staging area for review before production deployment.
This integration eliminates duplicate data entry, ensures inventory consistency across platforms, and reduces the time required to onboard large numbers of devices into rConfig.
Supported Platforms
Section titled “Supported Platforms”rConfig V8 has been tested and verified with the following upstream platforms:
Platform | rConfig V8 Support | Platform Version Tested | Documentation |
---|---|---|---|
Zabbix | ✓ Verified | 6.4.10+ | Zabbix Sync Setup |
Nautobot | ✓ Verified | 2.0+ | Nautobot Sync Setup |
NetBox | ✓ Verified | 3.5+ | NetBox Sync Setup |
How Device Sync Works
Section titled “How Device Sync Works”Device Sync follows a standard ETL (Extract, Transform, Load) pattern with a review stage:
- Extract: Connect to upstream platform API and retrieve device inventory data in raw format
- Transform: Parse and map upstream device attributes to rConfig format using tags and field mappings
- Load to staging: Import transformed devices into rConfig staging table for administrator review
- Review and approve: Administrator validates staged devices and resolves any mapping issues
- Import to production: Approved devices are moved from staging to active rConfig device inventory
- Schedule synchronization: Automated sync jobs keep inventory current with upstream platform changes
This idempotent process prevents duplicate device creation and maintains data integrity across synchronizations.
Key Benefits
Section titled “Key Benefits”Eliminate manual entry: Automatically import hundreds or thousands of devices without manual data entry.
Single source of truth: Maintain device inventory in your monitoring platform and sync to rConfig automatically.
Consistent metadata: Device attributes, tags, categories, and credentials stay synchronized across platforms.
Staged review process: Review and validate devices before they enter production inventory.
Scheduled synchronization: Keep device inventory current with automated sync jobs at regular intervals.
Error handling: Comprehensive logging identifies mapping issues and failed imports for easy troubleshooting.
Idempotent operations: Re-running sync jobs updates existing devices rather than creating duplicates.
ETL Process Explained
Section titled “ETL Process Explained”Extract Phase
Section titled “Extract Phase”Connection: rConfig connects to upstream platform API using authentication credentials
Filtering: Apply platform-specific filters to extract only relevant devices (e.g., by host group, site, or device role)
Raw retrieval: Device data is retrieved in the upstream platform’s native format
Validation: Verify API response structure and data completeness
Transform Phase
Section titled “Transform Phase”Tag parsing: Read rConfig-specific tags from upstream platform device metadata
Field mapping: Map upstream device attributes to rConfig fields:
- Hostname → Device name
- IP address → Management IP
- Platform tags → Device template, vendor, model
- Custom tags → Categories, tags, credential sets
Credential assignment: Associate devices with rConfig credential sets based on tag mappings
Template selection: Assign appropriate device templates based on vendor and platform type
Load to Staging Phase
Section titled “Load to Staging Phase”Staging import: Transformed devices are imported into device_sync_staging
table
Duplicate detection: Check for existing devices by hostname or IP address
Validation: Verify all required fields are present and valid
Error logging: Record any devices that fail validation with detailed error messages
Review and Approve Phase
Section titled “Review and Approve Phase”Administrator review: View staged devices in rConfig UI or via CLI commands
Conflict resolution: Resolve duplicate hostnames, missing credentials, or invalid templates
Selective approval: Choose which staged devices to import into production
Bulk operations: Approve all, reject all, or selectively import devices
Production Import Phase
Section titled “Production Import Phase”Device creation: Approved devices are created in main rConfig device inventory
Relationship linking: Associate devices with groups, tags, categories, and credentials
Initial backup: Schedule immediate configuration retrieval for newly imported devices
Staging cleanup: Clear staging table after successful import
Required Tag Mappings
Section titled “Required Tag Mappings”Upstream platforms must tag devices with rConfig-specific metadata for successful import:
Tag Name | Purpose | Value Format | Required |
---|---|---|---|
rconfig::template | Device template | Template ID or name | Yes |
rconfig::credentialset | Authentication credentials | Credential set ID or name | Yes |
rconfig::vendor | Device manufacturer | Vendor ID or name | Yes |
rconfig::category | Device category | Category ID or name | Yes |
rconfig::tag | Device tags | Comma-separated IDs or names | No |
rconfig::model | Device model | Model string | No |
rconfig::prompt | Command prompt regex | Prompt pattern | No |
rconfig::enable_prompt | Enable prompt regex | Enable prompt pattern | No |
Example upstream platform tagging:
Device: core-router-01.example.comTags: - rconfig::template=Cisco IOS - rconfig::credentialset=Production Routers - rconfig::vendor=Cisco - rconfig::category=Core Network - rconfig::tag=Router,Production,Core - rconfig::model=Catalyst 9500
Configuration Workflow
Section titled “Configuration Workflow”Initial Setup
Section titled “Initial Setup”- Configure upstream platform: Set up API access and authentication credentials
- Tag devices: Apply rConfig-specific tags to devices in upstream platform
- Configure rConfig connection: Add upstream platform connection details in rConfig
- Test connection: Verify API connectivity and authentication
- Configure field mappings: Define how upstream fields map to rConfig attributes
- Set up filters: Specify which devices to include in sync operations
First Synchronization
Section titled “First Synchronization”- Run initial sync: Execute manual sync to extract, transform, and load devices
- Review staged devices: Check staging table for validation errors or conflicts
- Resolve issues: Fix missing tags, invalid templates, or credential problems
- Approve devices: Import staged devices into production inventory
- Verify import: Confirm devices appear correctly in rConfig device list
- Test connectivity: Validate device connections and configuration retrieval
Ongoing Operations
Section titled “Ongoing Operations”- Schedule automated sync: Set up cron job or scheduled task for regular synchronization
- Monitor sync logs: Review sync job results and error logs periodically
- Update mappings: Adjust tag mappings as device inventory evolves
- Maintain upstream tags: Keep rConfig-specific tags current in upstream platform
CLI vs. UI Operations
Section titled “CLI vs. UI Operations”Device Sync can be managed through both command-line and web interface:
Command-Line Interface (CLI)
Section titled “Command-Line Interface (CLI)”Best for:
- Automated scripting and cron jobs
- Detailed troubleshooting with verbose output
- Integration with CI/CD pipelines
- Batch operations on large device inventories
Web Interface (UI)
Section titled “Web Interface (UI)”Best for:
- Visual review of staged devices
- Selective device approval
- Quick status checks
- Conflict resolution with context
Access: Navigate to Integrations > Device Sync > Select platform
Synchronization Best Practices
Section titled “Synchronization Best Practices”Start with test group: Begin with a small subset of devices to validate mappings before full-scale sync.
Maintain consistent tagging: Establish tagging standards in upstream platform and enforce them across device inventory.
Use credential sets: Create reusable credential sets in rConfig before syncing to streamline device authentication.
Schedule during maintenance windows: Run initial large-scale syncs during low-activity periods to avoid performance impact.
Review before production: Always review staged devices before importing to catch validation errors early.
Monitor sync logs: Regularly check sync job logs for errors, warnings, or devices that failed validation.
Keep mappings current: Update field mappings when adding new device types or changing upstream platform structure.
Document custom configurations: Maintain documentation for platform-specific filters and custom tag mappings.
Troubleshooting Common Issues
Section titled “Troubleshooting Common Issues”API connection failures
Section titled “API connection failures”Check network connectivity: Verify rConfig server can reach upstream platform API endpoint
Validate credentials: Confirm API token or username/password are correct and not expired
Review firewall rules: Ensure firewalls allow traffic between rConfig and upstream platform
Check API permissions: Verify API user has sufficient permissions to read device inventory
Missing required tags
Section titled “Missing required tags”Review upstream tagging: Check that all required rConfig tags are applied to devices
Verify tag format: Ensure tag values match expected format (ID vs. name, comma separation)
Check case sensitivity: Some platforms are case-sensitive for tag names
Update tag mappings: Modify field mappings if upstream platform uses different tag structure
Duplicate device conflicts
Section titled “Duplicate device conflicts”Identify duplicates: Review staging table for devices with matching hostnames or IPs
Update existing devices: Use update mode instead of create mode for known devices
Resolve manually: Decide which device record to keep and remove duplicates from staging
Adjust filters: Refine upstream platform filters to exclude unwanted duplicates
Template or credential errors
Section titled “Template or credential errors”Verify existence: Confirm template and credential set names/IDs exist in rConfig
Check permissions: Ensure sync user has access to referenced templates and credentials
Create missing resources: Add templates or credential sets before re-running sync
Use default values: Configure fallback template or credential set for devices with missing tags
Related Documentation
Section titled “Related Documentation”- Zabbix Sync Setup - Configure Zabbix integration
- Nautobot Sync Setup - Configure Nautobot integration
- NetBox Sync Setup - Configure NetBox integration
- Device Management - Understanding device configuration in rConfig
- Device Templates - Configuring device templates
- Connection Profiles - Setting up connection credentials