ASIC miners in a professional hosting facility with monitoring dashboards

Why Fleet Monitoring Is Non-Negotiable

An ASIC miner sitting idle costs money every second. A single Antminer S21 Pro consuming 3,510 watts at $0.055/kWh costs $4.63 per day in electricity whether it is hashing or not. In a 1,000-unit fleet, one hour of undetected downtime across just 5 percent of machines (50 units) means approximately $9.65 in lost revenue and $9.65 in wasted electricity. Scale that to a 10,000-unit operation and the numbers become significant enough to justify dedicated monitoring infrastructure.

Remote monitoring is what separates professional mining operations from hobbyist setups. It enables operators to detect problems before they become costly, automate routine remediation, and maintain fleet-wide visibility without requiring technicians to physically inspect every machine every day. For hosted mining operations where equipment owners may be thousands of miles from their hardware, monitoring is the primary interface between owner and equipment.

Essential Metrics to Track

Effective ASIC fleet monitoring requires tracking metrics across four categories: performance, thermal, electrical, and network.

Performance Metrics

Metric Source What It Tells You Alert Threshold
Device hashrate (real-time) Miner API (cgminer/bmminer) Instantaneous hashing speed per board and per unit Below 90% of rated hashrate for >5 min
Pool-reported hashrate Pool API/dashboard Effective hashrate seen by the pool (smoothed) Below 85% of expected for >15 min
Accepted shares Miner API Valid work submitted to the pool Share acceptance rate below 98%
Rejected shares Miner API Stale or invalid work (indicates latency or hardware issues) Reject rate above 2%
Hardware errors Miner API ASIC chip failures or instability Any non-zero HW error count increasing
Uptime Miner API / monitoring agent Time since last restart or downtime event Unexpected restart (uptime reset to 0)

Device vs. pool hashrate divergence: A persistent gap between device-reported and pool-reported hashrate (>10 percent) often indicates network issues (share submission latency), pool-side problems, or firmware bugs causing stale shares. Track both and alert on divergence.

Thermal Metrics

Temperature management is critical for ASIC longevity and consistent hashrate. Modern ASIC miners report multiple temperature sensors per unit.

  • Chip temperature (per board): The most important thermal metric. Antminer S21 series targets 65 to 80 degrees Celsius under normal operation. Chip temperatures above 85 degrees C trigger thermal throttling on most firmware, reducing hashrate to protect the silicon. Sustained operation above 90 degrees C risks permanent damage.
  • Board inlet temperature: The temperature of cooling air (or liquid) entering each hashboard. This reflects the effectiveness of the facility's airflow management and cooling infrastructure.
  • Board outlet temperature: Temperature of air leaving the hashboard. The delta between inlet and outlet indicates how much heat the board is generating and whether airflow volume is sufficient.
  • Fan speed (RPM): Miners auto-adjust fan speed based on temperature. Fans running at maximum RPM continuously indicate insufficient ambient cooling. Fan speed at zero or below minimum indicates a fan failure requiring physical intervention.

For facilities using immersion cooling or direct liquid cooling, thermal metrics shift from air temperatures to coolant inlet/outlet temperatures and flow rates. The principles are the same: track the delta, alert on anomalies.

Electrical Metrics

Power monitoring serves dual purposes: verifying that machines are drawing expected wattage (indicating normal operation) and tracking energy costs accurately.

  • Power consumption (watts): Measured at the PDU level per outlet or per circuit. An S21 Pro drawing significantly below its rated 3,510W may have failed hashboards. Drawing significantly above rated power could indicate a firmware issue or PSU problem.
  • Efficiency (J/TH): Calculated by dividing wall power by hashrate. This is the single most important operational efficiency metric. An S21 Pro should run at approximately 15 J/TH. If efficiency degrades to 18+ J/TH without a firmware or ambient temperature change, something is wrong.
  • Voltage and current per PSU: Available through the miner API on some models. Voltage sag or current imbalance between PSU outputs can indicate failing power supplies before they cause downtime.
  • Circuit-level current draw: Monitored at the breaker panel or smart PDU. Overloaded circuits approaching their rated capacity (e.g., 80 percent of a 30A breaker) require load redistribution before they trip.

Network Metrics

  • Connectivity status: Is the miner reachable on the local network (ping, HTTP API response)?
  • Pool connection: Is the miner connected to its assigned pool? Pool disconnections cause immediate revenue loss.
  • Latency to pool: High latency (>150ms) increases stale share rates. For large fleets, a local stratum proxy (like Braiins Farm Proxy) reduces per-miner connections and optimizes share submission.
  • DNS resolution: DNS failures silently prevent pool connections. Monitor DNS resolution independently.

Monitoring Architecture for Mining Facilities

A production monitoring architecture for a mining facility has three layers: data collection, processing and alerting, and visualization.

Layer 1: Data Collection

ASIC miners expose operational data through local HTTP APIs. The Bitmain CGMiner API, MicroBT API, and Canaan Avalon API each provide hashrate, temperature, fan speed, and pool connection data in JSON format. Collection approaches include:

  • Pull-based polling: A central collector queries each miner's API at regular intervals (30 to 60 seconds). Simple to implement but requires network access to every miner.
  • Agent-based: A lightweight agent runs on the miner (or a co-located Raspberry Pi / edge gateway per row) and pushes data to a central collector. More resilient to network interruptions.
  • SNMP: Some enterprise-grade firmware supports SNMP traps and polling, integrating with existing DCIM infrastructure.

Layer 2: Processing and Alerting

Raw data must be processed into actionable alerts and trends. The processing layer handles:

  • Threshold evaluation: Compare each metric against defined thresholds (temperature >85 C, hashrate <90 percent of rated, uptime reset, etc.)
  • Anomaly detection: Identify machines whose behavior deviates from fleet norms (e.g., one miner drawing 20 percent more power than identical units in the same row)
  • Aggregation: Roll up per-unit metrics to per-row, per-pod, per-facility totals for management dashboards
  • Alert routing: Send notifications via email, SMS, Telegram, PagerDuty, or webhook based on severity and time of day

Layer 3: Visualization and Reporting

Dashboards provide real-time fleet visibility and historical trend analysis. Key dashboard views include:

  • Fleet overview: Total hashrate, total power, fleet efficiency (J/TH), machine count by status (online/offline/degraded)
  • Heat map: Visual rack/row layout showing temperature or hashrate per position, making it easy to spot hotspots or clusters of failing machines
  • Individual unit detail: Drill-down to a single miner showing all metrics, event history, and maintenance log
  • Revenue tracking: Estimated daily/weekly/monthly revenue based on current hashrate, pool earnings, and electricity costs

Monitoring Tool Comparison

Several purpose-built tools serve the mining monitoring market, each with different strengths.

Tool Type Key Strengths Best For
Foreman Cloud-hosted SaaS Broad hardware support (Bitmain, MicroBT, Canaan, Innosilicon), auto-detection, remote commands, API access Hosting providers managing diverse fleets
Awesome Miner On-premise (Windows) + web dashboard 50+ supported miner types, profit switching, ASIC Scanner for network discovery, customizable triggers Mixed ASIC + GPU operations
Hive OS Linux-based (on-device or proxy) Strong GPU support, ASIC Hub for ASIC management, unified dashboard, farm-level organization Operations running both GPU and ASIC hardware
Braiins Farm Proxy Open-source, on-premise Stratum V2 support, hashrate aggregation, reduces pool connections, developer-friendly Large-scale facilities focused on pool connection optimization
Prometheus + Grafana (custom) Open-source stack Complete customization, integration with existing IT monitoring, unlimited data retention, no per-unit licensing fees Teams with DevOps capability who want full control

Cost consideration: SaaS monitoring tools typically charge per monitored device (ranging from $0.50 to $3.00 per miner per month). For a 5,000-unit fleet, this is $2,500 to $15,000 per month. Open-source alternatives eliminate licensing costs but require internal engineering time for setup and maintenance. The breakeven point for building custom monitoring depends on fleet size and available technical staff.

Automated Remediation: Beyond Alerting

Monitoring that only generates alerts is half a solution. The real operational leverage comes from automated remediation — systems that detect problems and fix them without human intervention.

Common Automated Actions

  1. Auto-reboot on hashrate drop: If a miner's hashrate falls below 80 percent of rated for more than 10 minutes and temperature is normal, issue a software reboot via the miner API. Many transient issues (memory errors, pool connection glitches, firmware state corruption) are resolved by a reboot.
  2. Power cycle on unresponsive: If a miner stops responding to API polls for more than 5 minutes, trigger a power cycle via smart PDU (cutting and restoring power at the outlet). This handles hard lockups that do not respond to software commands.
  3. Pool failover: If the primary pool becomes unreachable, automatically switch to a preconfigured backup pool. Most miner firmware has built-in pool failover, but fleet-level tools can enforce consistent failover policies across all machines.
  4. Thermal throttle enforcement: If chip temperature exceeds 85 degrees C, reduce clock frequency (underclock) until temperature stabilizes. This prevents hardware damage while keeping the miner online at reduced output rather than shutting it down entirely.
  5. Alert escalation: If automated remediation fails after N attempts (typically 2 to 3 reboots within an hour), escalate to on-site technicians via ticketing system with the miner's location (row, rack, unit position), diagnostic data, and recommended physical action.

Remediation Workflow Design

A well-designed remediation workflow follows a tiered approach:

  • Tier 0 (automatic): Software reboot, pool failover, thermal throttle — no human needed
  • Tier 1 (remote hands): Power cycle via PDU, remote hands physical inspection request — minimal human involvement
  • Tier 2 (on-site technician): Hardware inspection, board replacement, PSU swap, fan replacement — requires skilled personnel
  • Tier 3 (RMA/decommission): Machine fails repeated repairs, enters RMA process or is decommissioned

Monitoring for Hosted Miners

Miners who deploy hardware at a colocation or managed hosting facility face a unique challenge: they do not have physical access to their equipment. Monitoring is their primary interface.

What to Expect from Your Hosting Provider

When evaluating hosting providers, ask specific questions about monitoring capabilities:

  • Dashboard access: Does the provider offer a customer-facing dashboard showing per-unit hashrate, uptime, temperature, and power consumption? How frequently does it update?
  • Alert configuration: Can you set custom alert thresholds and receive notifications via your preferred channel (email, Telegram, webhook)?
  • Historical data: How far back is monitoring data retained? Can you export it for analysis?
  • API access: Is programmatic access available for integration with your own monitoring stack?
  • SLA measurement: Does the monitoring system feed into SLA uptime calculations? If uptime is guaranteed at 99.5 percent, what system measures and verifies it?
  • Incident reports: When issues occur, does the provider generate detailed incident reports including root cause, duration, machines affected, and remediation taken?

Independent Verification

Savvy hosted miners cross-reference provider monitoring data with independent sources:

  • Pool dashboard: Your mining pool reports hashrate independently. If the pool shows 50 TH/s but the provider claims your machine is running at 234 TH/s, something is wrong.
  • Daily payout tracking: Correlate daily pool payouts with expected revenue based on reported hashrate. Systematic shortfalls indicate unreported downtime or hashrate issues.
  • Third-party monitoring: Some monitoring tools (like Foreman) allow hosted miners to add their machines by IP address, providing an independent monitoring layer alongside the provider's system. This requires the provider to allow network access, which should be negotiated as part of the hosting contract.

Scaling Monitoring Infrastructure

Monitoring architecture must scale with fleet size. What works for 100 miners breaks down at 10,000.

Network Considerations

Each miner API poll generates approximately 2 to 5 KB of data. Polling 10,000 miners every 30 seconds produces 400 to 1,000 KB per second of monitoring traffic. This is manageable for modern networks but requires a dedicated monitoring VLAN to prevent monitoring traffic from competing with pool stratum connections on the same network segments.

Data Storage

Storing per-unit metrics at 30-second resolution for 10,000 miners generates approximately 28 million data points per day. Time-series databases (InfluxDB, TimescaleDB, Prometheus TSDB) handle this efficiently with compression, but retention policies must balance analysis needs against storage costs. A common approach: 30-second resolution for 7 days, 5-minute aggregates for 90 days, hourly aggregates for 2 years.

Collector Architecture

A single monitoring collector can typically handle 1,000 to 3,000 miners depending on poll frequency and hardware. Beyond that, use distributed collectors per section of the facility, aggregating data into a central time-series database. Each collector runs as an independent process that can fail without affecting the others.

Security Considerations

Mining monitoring systems have access to critical operational controls (reboot, power cycle, pool configuration). Securing this infrastructure is essential.

  • Network segmentation: Place miners and monitoring infrastructure on isolated VLANs with firewall rules restricting access. Miners should only be reachable from the monitoring network and the pool stratum connection, not from the general internet.
  • Authentication: Change default passwords on all miner web interfaces. Many ASIC miners ship with factory defaults (root/root) that provide full administrative access. A single compromised machine can be used to redirect hashrate to an attacker's pool.
  • Encrypted connections: Use HTTPS for monitoring dashboards and VPN tunnels for remote access. Monitoring data in transit can reveal fleet composition, hashrate, and operational patterns.
  • Firmware integrity: Monitor firmware versions across the fleet. Unauthorized firmware modifications can divert a percentage of hashrate (devfee attacks) or create backdoors. Compare running firmware hashes against known-good versions.
  • Access control: Implement role-based access for monitoring systems. Operators who need to view dashboards should not necessarily have permission to reboot machines or change pool configurations.

Environmental Monitoring Integration

ASIC fleet monitoring should integrate with broader facility environmental monitoring for complete operational visibility.

  • Ambient temperature and humidity sensors: Deploy per-row or per-aisle to track the environment affecting ASIC intake temperatures. ASHRAE guidelines recommend 18 to 27 degrees C inlet temperature for IT equipment.
  • Differential pressure: Monitor pressure between hot and cold aisles in contained environments to verify containment integrity.
  • Power monitoring at the utility/generator level: Correlate facility-level power draw with the sum of all miner consumption to detect metering discrepancies or parasitic loads.
  • Cooling system status: CRAH/CRAC unit operating status, chiller plant metrics, and coolant temperatures feed into the same monitoring platform for holistic alerting.

Rax Monitoring Infrastructure

Rax Data & Energy provides hosted miners with comprehensive fleet visibility through its monitoring platform. Clients deploying ASIC equipment in Rax facilities receive per-unit hashrate and power tracking, configurable alert thresholds, historical performance data, and regular operational reports. The monitoring infrastructure is integrated with Rax's facility management systems, enabling rapid response when automated remediation escalates to on-site technician intervention.

For miners evaluating hosting options, Rax's monitoring capabilities are designed to provide the same level of operational visibility you would have in your own facility — without the capital cost of building monitoring infrastructure yourself.

Frequently Asked Questions

What metrics should I monitor for ASIC mining fleets?

The essential metrics are: real-time hashrate per unit and aggregate, chip and board temperatures (inlet and outlet), fan speeds (RPM), power consumption at the wall (watts), pool-reported hashrate vs device-reported hashrate, accepted and rejected shares, network connectivity and uptime, and firmware version. Advanced monitoring adds efficiency (J/TH), environmental conditions, and PDU-level current draw.

What are the best tools for monitoring ASIC miners remotely?

Popular tools include Foreman (cloud-based, broad hardware support), Awesome Miner (Windows-based, 50+ miner types), Hive OS (Linux-based, mixed GPU/ASIC), Braiins Farm Proxy (open-source, Stratum V2), and custom Prometheus/Grafana stacks. The best choice depends on fleet size, hardware diversity, and whether you prefer SaaS or self-hosted solutions.

How often should ASIC miners be polled for monitoring data?

For operational monitoring, polling every 30 to 60 seconds is standard for hashrate and temperature. Environmental sensors can be sampled every 5 minutes. Pool-side hashrate should be checked every 10 to 15 minutes since pool rates are smoothed over longer windows. Alert thresholds should be evaluated on every poll cycle.

What automated actions can monitoring systems trigger for ASIC miners?

Common automated actions include: automatic reboot of unresponsive miners, power cycling via smart PDU, automatic pool failover, fan speed adjustment, hashrate throttling when temperatures exceed limits, and alert escalation to technicians when automated fixes fail. Advanced systems also automate fleet-wide firmware updates during maintenance windows.

How do hosted miners access monitoring data from their colocation provider?

Professional hosting providers offer customer dashboards showing per-unit hashrate, uptime, and power consumption. Many also provide API access for programmatic retrieval, configurable email and SMS alerts, scheduled performance reports, and VPN access to on-site monitoring infrastructure. When evaluating providers, confirm what data is available, update frequency, and historical data retention.

Host with Full Visibility

Rax provides comprehensive monitoring for hosted ASIC fleets — per-unit hashrate tracking, temperature alerts, power metrics, and automated incident response. Deploy your miners with confidence.

Contact Us View Pricing