You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-22 - 10:15

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack8slot6s.osadl.org (updated Sat Nov 22, 2025 00:43:44)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3803992828,0cyclictest28083-21fwupd22:16:213
3803991918,1cyclictest66850irq/125-lan21:51:463
3803991918,1cyclictest66850irq/125-lan21:35:133
3803991818,0cyclictest66850irq/125-lan23:15:183
3803991818,0cyclictest66850irq/125-lan22:05:123
3803991818,0cyclictest66850irq/125-lan00:18:393
3803991818,0cyclictest66850irq/125-lan00:08:553
3803991817,1cyclictest66850irq/125-lan23:55:103
3803991817,1cyclictest66850irq/125-lan23:40:443
3803991817,1cyclictest66850irq/125-lan23:35:233
3803991817,1cyclictest66850irq/125-lan22:55:323
3803991817,1cyclictest66850irq/125-lan22:50:153
3803991817,1cyclictest66850irq/125-lan22:43:253
3803991817,1cyclictest66850irq/125-lan22:21:103
3803991817,1cyclictest66850irq/125-lan22:04:163
3803991817,1cyclictest66850irq/125-lan21:55:473
3803991817,1cyclictest66850irq/125-lan21:55:473
3803991817,1cyclictest66850irq/125-lan21:25:243
3803991817,1cyclictest66850irq/125-lan21:15:163
3803991817,1cyclictest66850irq/125-lan19:26:003
3803991817,1cyclictest66850irq/125-lan00:39:473
3803991817,1cyclictest66850irq/125-lan00:31:283
3803991717,0cyclictest66850irq/125-lan23:47:543
3803991717,0cyclictest66850irq/125-lan23:20:283
3803991717,0cyclictest66850irq/125-lan23:10:213
3803991717,0cyclictest66850irq/125-lan22:45:153
3803991717,0cyclictest66850irq/125-lan22:31:133
3803991717,0cyclictest66850irq/125-lan21:40:163
3803991717,0cyclictest66850irq/125-lan20:57:473
3803991717,0cyclictest66850irq/125-lan20:49:503
3803991717,0cyclictest66850irq/125-lan20:00:173
3803991717,0cyclictest66850irq/125-lan00:00:473
3803991716,1cyclictest66850irq/125-lan23:50:163
3803991716,1cyclictest66850irq/125-lan23:30:113
3803991716,1cyclictest66850irq/125-lan23:25:153
3803991716,1cyclictest66850irq/125-lan23:05:573
3803991716,1cyclictest66850irq/125-lan22:37:113
3803991716,1cyclictest66850irq/125-lan22:25:233
3803991716,1cyclictest66850irq/125-lan22:10:193
3803991716,1cyclictest66850irq/125-lan21:30:573
3803991716,1cyclictest66850irq/125-lan21:21:503
3803991716,1cyclictest66850irq/125-lan21:10:103
3803991716,1cyclictest66850irq/125-lan00:25:113
3803991616,0cyclictest66850irq/125-lan23:02:343
3803991616,0cyclictest66850irq/125-lan21:45:243
3803991616,0cyclictest66850irq/125-lan21:00:133
3803991616,0cyclictest66850irq/125-lan20:50:143
3803991616,0cyclictest66850irq/125-lan20:31:213
3803991615,1cyclictest66850irq/125-lan19:10:153
3803991615,1cyclictest66850irq/125-lan00:20:013
3803991515,0cyclictest66850irq/125-lan19:49:203
3803991515,0cyclictest66850irq/125-lan19:35:163
3803991514,1cyclictest66850irq/125-lan20:35:203
3803991414,0cyclictest66850irq/125-lan20:25:123
3803991413,1cyclictest66850irq/125-lan21:05:173
3803991413,1cyclictest66850irq/125-lan20:20:233
3803991413,1cyclictest66850irq/125-lan20:08:193
3803991413,1cyclictest66850irq/125-lan19:30:193
3803991413,1cyclictest66850irq/125-lan00:10:263
3803991313,0cyclictest66850irq/125-lan19:55:173
3803991313,0cyclictest66850irq/125-lan19:40:193
3803991313,0cyclictest66850irq/125-lan19:20:203
3803991211,1cyclictest66850irq/125-lan20:40:023
3803991211,1cyclictest66850irq/125-lan20:10:163
3803991211,1cyclictest66850irq/125-lan19:15:223
3803991110,1cyclictest66850irq/125-lan19:50:163
37989998,1cyclictest771-21snmpd19:38:272
37949998,1cyclictest771-21snmpd00:32:561
37909998,1cyclictest771-21snmpd22:26:120
37909998,1cyclictest771-21snmpd21:13:430
37909998,1cyclictest771-21snmpd20:55:010
37909998,1cyclictest769-21lldpd23:10:210
38039988,0cyclictest66850irq/125-lan20:15:123
37989988,0cyclictest771-21snmpd22:32:162
37989988,0cyclictest771-21snmpd22:03:032
37989988,0cyclictest771-21snmpd21:34:532
37989988,0cyclictest771-21snmpd20:43:182
37989988,0cyclictest771-21snmpd20:15:142
37989988,0cyclictest769-21lldpd23:28:592
37989988,0cyclictest769-21lldpd22:51:132
37989988,0cyclictest769-21lldpd21:27:172
37989988,0cyclictest769-21lldpd20:45:472
37989988,0cyclictest769-21lldpd20:03:142
37989988,0cyclictest769-21lldpd00:37:142
37989987,1cyclictest771-21snmpd23:07:442
37989987,1cyclictest771-21snmpd19:14:462
37989987,1cyclictest524-21avahi-daemon22:44:322
37989987,1cyclictest524-21avahi-daemon22:22:092
37989987,1cyclictest524-21avahi-daemon21:37:562
37989986,2cyclictest771-21snmpd23:47:032
37989986,2cyclictest771-21snmpd23:43:152
37989986,2cyclictest771-21snmpd21:07:542
37989986,2cyclictest771-21snmpd19:31:342
37989986,2cyclictest14671-21cat22:35:152
37989986,1cyclictest771-21snmpd23:36:452
37949988,0cyclictest771-21snmpd21:46:411
37949988,0cyclictest771-21snmpd20:42:061
37949988,0cyclictest771-21snmpd20:26:391
37949988,0cyclictest771-21snmpd20:14:201
37949988,0cyclictest771-21snmpd19:34:191
37949988,0cyclictest771-21snmpd00:25:171
37949988,0cyclictest771-21snmpd00:00:161
37949988,0cyclictest769-21lldpd23:31:511
37949988,0cyclictest769-21lldpd21:52:361
37949988,0cyclictest769-21lldpd20:54:191
37949987,1cyclictest771-21snmpd22:59:591
37949987,1cyclictest771-21snmpd21:37:441
37949987,1cyclictest771-21snmpd21:27:131
37949987,1cyclictest771-21snmpd19:23:031
37949987,1cyclictest584-21in:imuxsock20:00:011
37949987,1cyclictest517-21systemd-resolve23:11:061
37949987,1cyclictest19045-21dump-pmu-power22:40:011
37949986,2cyclictest771-21snmpd23:51:211
37949986,2cyclictest771-21snmpd23:25:571
37949986,2cyclictest771-21snmpd21:02:341
37949986,2cyclictest771-21snmpd19:39:331
37909988,0cyclictest771-21snmpd23:16:260
37909988,0cyclictest771-21snmpd21:17:400
37909988,0cyclictest771-21snmpd19:32:430
37909988,0cyclictest769-21lldpd23:52:440
37909988,0cyclictest769-21lldpd21:41:580
37909988,0cyclictest769-21lldpd21:37:540
37909987,1cyclictest771-21snmpd23:21:490
37909987,1cyclictest771-21snmpd20:58:480
37909987,1cyclictest771-21snmpd20:26:560
37909987,1cyclictest769-21lldpd23:26:470
37909987,1cyclictest769-21lldpd20:34:210
37909986,2cyclictest771-21snmpd23:56:000
37909986,2cyclictest771-21snmpd21:55:410
37909986,2cyclictest771-21snmpd21:55:410
37909986,2cyclictest771-21snmpd19:45:460
37909986,2cyclictest771-21snmpd00:18:190
37989977,0cyclictest771-21snmpd23:16:322
37989977,0cyclictest771-21snmpd20:35:382
37989977,0cyclictest771-21snmpd20:05:342
37989977,0cyclictest771-21snmpd00:17:402
37989977,0cyclictest771-21snmpd00:14:312
37989977,0cyclictest771-21snmpd00:08:102
37989977,0cyclictest769-21lldpd00:23:202
37989976,1cyclictest524-21avahi-daemon23:30:202
37989976,1cyclictest524-21avahi-daemon20:12:212
37989976,1cyclictest524-21avahi-daemon19:57:212
37989976,1cyclictest517-21systemd-resolve21:53:422
37989976,1cyclictest517-21systemd-resolve21:19:582
37989976,1cyclictest255-20systemd-journal22:56:142
37989975,2cyclictest771-21snmpd22:17:182
37989975,2cyclictest771-21snmpd22:07:272
37989975,2cyclictest771-21snmpd20:25:332
37949977,0cyclictest771-21snmpd20:33:361
37949977,0cyclictest771-21snmpd00:12:041
37949977,0cyclictest771-21snmpd00:07:191
37949977,0cyclictest769-21lldpd22:20:401
37949977,0cyclictest769-21lldpd22:06:261
37949977,0cyclictest769-21lldpd20:57:571
37949977,0cyclictest769-21lldpd20:38:271
37949977,0cyclictest769-21lldpd20:16:461
37949976,1cyclictest771-21snmpd21:59:571
37949976,1cyclictest771-21snmpd21:59:571
37949976,1cyclictest771-21snmpd21:40:201
37949976,1cyclictest524-21avahi-daemon21:20:181
37949976,1cyclictest524-21avahi-daemon19:29:551
37949976,1cyclictest1-21systemd19:59:171
37949975,2cyclictest771-21snmpd23:03:561
37949975,2cyclictest771-21snmpd22:44:461
37949975,2cyclictest771-21snmpd22:03:571
37949975,2cyclictest771-21snmpd21:19:311
37949975,2cyclictest771-21snmpd20:20:091
37909977,0cyclictest771-21snmpd23:30:330
37909977,0cyclictest771-21snmpd20:13:500
37909977,0cyclictest769-21lldpd19:57:180
37909977,0cyclictest769-21lldpd00:01:360
37909976,1cyclictest771-21snmpd00:26:560
37909976,1cyclictest771-21snmpd00:20:250
37909976,1cyclictest5491-21cpuspeed_turbos00:35:130
37909976,1cyclictest524-21avahi-daemon23:45:500
37909976,1cyclictest524-21avahi-daemon22:31:490
37909976,1cyclictest524-21avahi-daemon19:35:150
37909976,1cyclictest4446-21munin-plugin-st21:25:010
37909975,2cyclictest771-21snmpd23:04:020
37909975,2cyclictest771-21snmpd22:19:480
37909975,2cyclictest771-21snmpd19:24:400
37909975,2cyclictest19891-21cat22:40:150
37909973,3cyclictest255-20systemd-journal21:48:350
37909972,5cyclictest550-21NetworkManager19:44:080
37989966,0cyclictest771-21snmpd22:49:192
37989966,0cyclictest769-21lldpd22:28:322
37989966,0cyclictest769-21lldpd21:01:332
37989966,0cyclictest769-21lldpd20:21:052
37989966,0cyclictest769-21lldpd00:28:482
37989965,1cyclictest8389-21cut19:20:152
37989965,1cyclictest771-21snmpd20:57:372
37989965,1cyclictest22121-21needreboot21:10:162
37989964,2cyclictest771-21snmpd23:55:242
37989964,2cyclictest771-21snmpd21:23:032
37989964,2cyclictest771-21snmpd19:45:132
37989964,2cyclictest771-21snmpd00:32:172
37989963,2cyclictest30770-21ssh21:49:022
37989962,3cyclictest30354-21ssh23:21:092
37989962,3cyclictest27932-21ld23:50:162
37989962,3cyclictest255-20systemd-journal23:01:462
37989962,3cyclictest255-20systemd-journal00:00:032
37989962,3cyclictest23215-21ssh22:11:502
37989962,3cyclictest21374-21sh23:13:002
37949966,0cyclictest771-21snmpd22:16:511
37949966,0cyclictest769-21lldpd23:43:351
37949966,0cyclictest524-21avahi-daemon21:06:161
37949966,0cyclictest524-21avahi-daemon19:10:401
37949965,1cyclictest771-21snmpd20:45:511
37949965,1cyclictest771-21snmpd00:18:371
37949965,1cyclictest769-21lldpd00:23:401
37949965,1cyclictest13141-21fschecks_count23:05:131
37949964,2cyclictest771-21snmpd23:55:331
37949964,2cyclictest771-21snmpd22:54:161
37949964,2cyclictest771-21snmpd21:10:041
37949964,2cyclictest771-21snmpd19:40:551
37949963,2cyclictest586-21rs:main1
37949963,2cyclictest27969-21ssh22:48:071
37949963,2cyclictest255-20systemd-journal23:20:281
37949962,3cyclictest255-20systemd-journal22:26:411
37949962,3cyclictest25508-21ssh23:16:351
37909966,0cyclictest771-21snmpd23:43:480
37909966,0cyclictest769-21lldpd20:45:290
37909965,1cyclictest771-21snmpd22:35:300
37909965,1cyclictest524-21avahi-daemon20:09:250
37909965,1cyclictest3142-21cat22:55:140
37909965,1cyclictest255-20systemd-journal22:12:590
37909965,1cyclictest12173-21gltestperf23:35:140
37909964,2cyclictest771-21snmpd19:19:250
37909964,2cyclictest771-21snmpd19:10:040
37909963,2cyclictest16290-21sh00:10:490
37909962,3cyclictest3997-21sh00:34:000
37909962,3cyclictest14359-21users23:05:200
37909962,3cyclictest12612-21ssh00:07:270
37909960,4cyclictest21016-21diskmemload22:45:320
37989954,1cyclictest5246-21cpuspeed_turbos21:55:142
37989954,1cyclictest5246-21cpuspeed_turbos21:55:142
37989954,1cyclictest13915-21ntp_192.168.11420:50:142
37989953,2cyclictest771-21snmpd20:32:542
37989951,3cyclictest6727-21ld19:15:182
37989951,3cyclictest24232-21ssh21:42:432
37989951,3cyclictest20542-21apt19:50:122
37949954,1cyclictest20932-21hddtemp_smartct19:50:141
37949954,1cyclictest16419-21kworker/1:1+events21:30:331
37949953,2cyclictest771-21snmpd23:48:271
37949952,2cyclictest255-20systemd-journal19:16:561
37949952,2cyclictest11783-21ssh23:35:111
37949951,3cyclictest22619-21sh22:11:011
37949951,2cyclictest27262-21head20:05:151
37949950,4cyclictest4941-21readlink00:35:001
37909955,0cyclictest769-21lldpd20:22:240
37909955,0cyclictest769-21lldpd20:16:440
37909955,0cyclictest524-21avahi-daemon21:05:280
37909953,2cyclictest771-21snmpd20:02:350
37909953,2cyclictest171ktimers/021:25:130
37909952,2cyclictest31800-21sed22:20:140
37909952,2cyclictest31158-21uname22:50:210
37909952,2cyclictest255-20systemd-journal21:50:010
37909952,2cyclictest255-20systemd-journal21:00:020
37909952,2cyclictest15351-21ssh22:05:010
37909952,2cyclictest12758-21ssh22:01:420
37909952,2cyclictest10569-21forks21:30:140
37909950,5cyclictest10523-21turbostat20:44:590
37909950,3cyclictest22466-21cat19:55:000
37989944,0cyclictest769-21lldpd19:40:082
37989940,3cyclictest11019-21sshd19:25:212
37909941,2cyclictest10235-21cut19:25:150
37909940,3cyclictest6482-21diskstats20:35:150
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional