You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-30 - 22:21

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack8slot6s.osadl.org (updated Sun Aug 30, 2026 12:43:39)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
47889910521048,4cyclictest23120-21turbostat10:24:563
47889910481047,1cyclictest14860-21kworker/3:2+events09:01:503
47809910461044,2cyclictest32363-21turbostat10:34:551
47889910451043,2cyclictest22912-21kworker/3:0+events11:04:263
47889910431042,1cyclictest4629-21kworker/3:0+events07:16:473
47889910421041,1cyclictest7316-21kworker/3:1+events09:32:133
47889910381036,2cyclictest7316-21kworker/3:1+events09:36:593
47889910381035,3cyclictest10846-21turbostat08:44:553
47889910361034,2cyclictest2401-21kworker/3:2+events11:10:233
47889910351034,1cyclictest3970-21kworker/3:1+events08:26:503
47889910331031,2cyclictest2401-21kworker/3:2+events11:06:283
47889910301028,2cyclictest7200-21kworker/3:1+events11:18:173
47889910301028,2cyclictest14860-21kworker/3:2+events08:59:203
47889910291027,2cyclictest4629-21kworker/3:0+events07:34:043
47809910291028,1cyclictest4602-21kworker/1:0+events12:37:351
47889910281026,2cyclictest22181-21turbostat07:54:563
47889910271025,2cyclictest9945-21kworker/3:2+events10:07:453
47889910271024,3cyclictest13320-21kworker/3:2+events07:48:053
47889910261024,2cyclictest4629-21kworker/3:0+events07:24:023
47889910261024,2cyclictest13320-21kworker/3:2+events07:36:083
47889910261023,3cyclictest24921-21kworker/3:0+events09:21:063
47889910251023,2cyclictest26869-21kworker/3:0+events10:19:203
47889910251023,2cyclictest19970-21kworker/3:0+events08:19:003
47889910241023,1cyclictest22912-21kworker/3:0+events10:55:443
47889910221021,1cyclictest24921-21kworker/3:0+events09:43:183
47889910221020,2cyclictest8079-21kworker/3:0+events08:36:503
47889910221020,2cyclictest2475-21kworker/3:2+events09:26:073
47889910221019,3cyclictest7200-21kworker/3:1+events11:31:053
47889910221019,2cyclictest26869-21kworker/3:0+events09:55:213
47839910221021,1cyclictest650-21kworker/2:0+events12:26:172
47889910201018,2cyclictest26869-21kworker/3:0+events09:51:063
47889910201018,2cyclictest17136-21kworker/3:1+events09:08:193
47889910201018,2cyclictest13320-21kworker/3:2+events07:42:123
47889910191017,2cyclictest17136-21kworker/3:1+events09:16:053
47889910171016,1cyclictest23483-21kworker/3:0+events12:11:493
47889910161014,2cyclictest17136-21kworker/3:1+events09:12:123
47759910161014,2cyclictest12876-21turbostat08:49:560
47889910151013,2cyclictest7200-21kworker/3:1+events11:22:563
47889910141012,2cyclictest26869-21kworker/3:0+events10:02:563
47839910141013,1cyclictest1786-21kworker/2:0+events10:49:442
47889910131010,3cyclictest4629-21kworker/3:0+events07:12:123
47889910131010,3cyclictest19970-21kworker/3:0+events08:21:513
47809910131010,3cyclictest32264-21turbostat09:24:551
47839910121011,1cyclictest650-21kworker/2:0+events12:17:532
47839910121011,1cyclictest1786-21kworker/2:0+events10:44:472
47889910111009,2cyclictest26869-21kworker/3:0+events10:13:593
47759910111009,2cyclictest18525-21turbostat10:19:550
47889910091008,1cyclictest23483-21kworker/3:0+events12:07:413
47889910091007,2cyclictest6036-21kworker/3:2+events08:30:223
47889910081006,2cyclictest7200-21kworker/3:1+events11:28:033
47889910071005,2cyclictest21995-21kworker/3:1+events09:48:473
47889910061003,3cyclictest14860-21kworker/3:2+events08:52:103
47839910061005,1cyclictest1786-21kworker/2:0+events10:32:442
47839910051005,0cyclictest16787-21kworker/2:1+events12:33:262
47839910031002,1cyclictest14709-21kworker/2:1+events07:54:122
4788991002999,2cyclictest4629-21kworker/3:0+events07:27:113
47839910021001,1cyclictest2288-21kworker/2:1+events11:43:372
47839910021001,1cyclictest1786-21kworker/2:0+events11:49:442
47839910011000,1cyclictest9133-21kworker/2:2+events11:54:302
47839910011000,1cyclictest27699-21kworker/2:2+events10:28:472
47839910011000,1cyclictest1786-21kworker/2:0+events11:36:482
477599999997,2cyclictest16068-21turbostat07:39:560
478399998997,1cyclictest650-21kworker/2:0+events12:22:342
478399998995,1cyclictest14013-21kworker/2:1+events11:59:002
477599997996,1cyclictest19285-21kworker/0:0+events12:04:160
478399996995,1cyclictest6726-21kworker/2:1+events10:37:012
478399996995,1cyclictest6726-21kworker/2:1+events10:37:002
478399990988,2cyclictest20326-21kworker/2:1+events10:52:302
478399990987,3cyclictest28145-21turbostat12:14:552
477599976975,1cyclictest28618-21kworker/0:1+events08:00:220
477599974972,2cyclictest14203-21turbostat12:34:550
478899967964,3cyclictest18923-21turbostat12:04:543
478099961959,2cyclictest18386-21turbostat10:54:551
478399930928,2cyclictest30256-21turbostat08:14:562
478099930928,2cyclictest16891-21turbostat08:59:551
478099925923,2cyclictest23683-21turbostat11:34:541
478899912910,2cyclictest14323-21turbostat11:59:553
477599907906,1cyclictest28618-21kworker/0:1+events08:09:250
478099904903,1cyclictest18660-21turbostat11:29:541
477599896895,1cyclictest30062-21kworker/0:0+events08:14:110
477599890889,1cyclictest28618-21kworker/0:1+events07:56:070
478399877875,2cyclictest32627-21turbostat11:09:552
478899693691,2cyclictest12876-21turbostat08:49:563
477599668667,1cyclictest10846-21turbostat08:44:550
477599662659,3cyclictest22181-21turbostat07:54:550
478399605603,2cyclictest20176-21turbostat07:49:552
478399590587,3cyclictest23120-21turbostat10:24:562
478399572571,1cyclictest23683-21turbostat11:34:552
477599544543,1cyclictest14323-21turbostat11:59:550
478099542539,3cyclictest14203-21turbostat12:34:551
478899499498,1cyclictest30256-21turbostat08:14:563
478899450447,3cyclictest18386-21turbostat10:54:553
4780991918,1cyclictest67750irq/123-lan12:18:011
4780991918,1cyclictest67750irq/123-lan11:50:301
4780991918,1cyclictest67750irq/123-lan11:42:291
4780991918,1cyclictest67750irq/123-lan11:35:101
4780991918,1cyclictest67750irq/123-lan07:40:121
4783991818,0cyclictest784-21snmpd11:27:392
4783991818,0cyclictest784-21snmpd11:17:482
4783991818,0cyclictest784-21snmpd09:15:222
4783991818,0cyclictest784-21snmpd08:30:072
4780991818,0cyclictest67750irq/123-lan10:49:481
4780991818,0cyclictest67750irq/123-lan09:18:211
4780991818,0cyclictest67750irq/123-lan08:44:151
4780991817,1cyclictest67750irq/123-lan12:05:151
4780991817,1cyclictest67750irq/123-lan11:59:431
4780991817,1cyclictest67750irq/123-lan10:30:001
4780991817,1cyclictest67750irq/123-lan09:50:041
4780991817,1cyclictest67750irq/123-lan09:10:191
4780991817,1cyclictest67750irq/123-lan08:20:151
4783991717,0cyclictest784-21snmpd12:06:162
4783991717,0cyclictest784-21snmpd09:59:572
4783991717,0cyclictest784-21snmpd09:25:232
4780991717,0cyclictest67750irq/123-lan12:21:391
4780991717,0cyclictest67750irq/123-lan11:15:141
4780991716,1cyclictest67750irq/123-lan12:25:161
4780991716,1cyclictest67750irq/123-lan12:11:591
4780991716,1cyclictest67750irq/123-lan11:20:151
4780991716,1cyclictest67750irq/123-lan11:06:301
4780991716,1cyclictest67750irq/123-lan10:55:201
4780991716,1cyclictest67750irq/123-lan10:40:161
4780991716,1cyclictest67750irq/123-lan10:20:161
4780991716,1cyclictest67750irq/123-lan10:14:101
4780991716,1cyclictest67750irq/123-lan09:45:591
4780991716,1cyclictest67750irq/123-lan09:25:181
4780991716,1cyclictest67750irq/123-lan08:25:131
4780991716,1cyclictest67750irq/123-lan07:10:131
4783991616,0cyclictest784-21snmpd08:26:422
4780991616,0cyclictest67750irq/123-lan09:36:271
4780991616,0cyclictest67750irq/123-lan08:05:181
4780991616,0cyclictest67750irq/123-lan07:55:201
4780991615,1cyclictest67750irq/123-lan12:01:051
4780991615,1cyclictest67750irq/123-lan11:12:391
4780991615,1cyclictest67750irq/123-lan11:01:021
4780991615,1cyclictest67750irq/123-lan10:35:161
4780991615,1cyclictest67750irq/123-lan10:35:151
4780991615,1cyclictest67750irq/123-lan10:16:111
4780991615,1cyclictest67750irq/123-lan10:05:171
4780991615,1cyclictest67750irq/123-lan09:56:501
4780991615,1cyclictest67750irq/123-lan09:44:261
4780991615,1cyclictest67750irq/123-lan09:34:441
4780991615,1cyclictest67750irq/123-lan08:50:141
4780991615,1cyclictest67750irq/123-lan08:48:141
4780991514,1cyclictest67750irq/123-lan10:01:551
4780991514,1cyclictest67750irq/123-lan09:05:171
4780991514,1cyclictest67750irq/123-lan08:35:181
4780991514,1cyclictest67750irq/123-lan08:15:011
4780991514,1cyclictest67750irq/123-lan07:50:131
4780991514,1cyclictest67750irq/123-lan07:35:181
4780991414,0cyclictest67750irq/123-lan11:45:141
4780991413,1cyclictest67750irq/123-lan07:15:131
4775991414,0cyclictest13422-21kworker/0:2+events_freezable09:25:370
4780991313,0cyclictest67750irq/123-lan08:15:131
4780991312,1cyclictest67750irq/123-lan09:00:111
4780991312,1cyclictest67750irq/123-lan07:20:111
4780991212,0cyclictest67750irq/123-lan07:45:181
4780991211,1cyclictest67750irq/123-lan08:30:151
4780991211,1cyclictest67750irq/123-lan08:04:281
4780991110,1cyclictest67750irq/123-lan07:30:171
4780991110,1cyclictest67750irq/123-lan07:25:171
478899107,3cyclictest784-21snmpd12:25:483
478899102,3cyclictest547-21NetworkManager11:52:083
47889998,1cyclictest784-21snmpd10:35:233
47889998,1cyclictest784-21snmpd10:35:223
47889995,4cyclictest32228-21kworker/u16:1-writeback11:40:163
47839999,0cyclictest784-21snmpd10:56:392
47839998,1cyclictest784-21snmpd09:10:492
47759998,1cyclictest526-21avahi-daemon11:40:110
47889988,0cyclictest782-21lldpd12:15:153
47889987,1cyclictest784-21snmpd12:38:573
47889987,1cyclictest526-21avahi-daemon12:30:463
47889986,2cyclictest784-21snmpd08:00:383
47889986,2cyclictest14621-21cat10:45:133
47889983,3cyclictest29466-21ld11:35:153
47889983,2cyclictest784-21snmpd10:25:013
47839988,0cyclictest782-21lldpd08:57:232
47839988,0cyclictest782-21lldpd08:18:212
47839987,1cyclictest784-21snmpd12:03:492
47839987,1cyclictest784-21snmpd08:54:212
47839986,2cyclictest784-21snmpd09:41:332
47839986,2cyclictest784-21snmpd08:08:592
47839986,2cyclictest762-21ntpd09:05:472
47839986,2cyclictest762-21ntpd08:41:322
47839986,2cyclictest762-21ntpd08:35:442
47759988,0cyclictest784-21snmpd10:58:510
47759988,0cyclictest784-21snmpd10:06:220
47759988,0cyclictest784-21snmpd09:12:380
47759988,0cyclictest784-21snmpd07:23:240
47759988,0cyclictest782-21lldpd10:46:410
47759988,0cyclictest526-21avahi-daemon10:50:580
47759987,1cyclictest784-21snmpd09:44:530
47759987,1cyclictest782-21lldpd07:34:220
47759987,1cyclictest526-21avahi-daemon11:46:470
47759987,1cyclictest507-21systemd-resolve10:10:200
47759987,1cyclictest507-21systemd-resolve09:23:030
47759986,2cyclictest784-21snmpd12:05:520
47759986,2cyclictest784-21snmpd11:16:300
47889972,2cyclictest8656-21ssh12:23:253
47889972,2cyclictest1219-21ntpq10:30:173
47889970,3cyclictest5902-21hddtemp_smartct11:45:133
47889970,3cyclictest29235-21ntpq08:05:163
47889970,3cyclictest10349-21ntpq10:40:173
47839977,0cyclictest782-21lldpd10:10:422
47839977,0cyclictest782-21lldpd10:04:312
47839977,0cyclictest782-21lldpd07:25:142
47839977,0cyclictest526-21avahi-daemon11:02:192
47759977,0cyclictest784-21snmpd12:26:320
47759977,0cyclictest784-21snmpd12:19:030
47759977,0cyclictest784-21snmpd11:26:450
47759977,0cyclictest784-21snmpd07:28:270
47759977,0cyclictest782-21lldpd11:35:500
47759977,0cyclictest782-21lldpd10:29:190
47759977,0cyclictest782-21lldpd09:53:310
47759977,0cyclictest782-21lldpd09:45:050
47759976,1cyclictest784-21snmpd08:37:450
47759975,2cyclictest784-21snmpd08:31:550
47759975,2cyclictest784-21snmpd07:17:100
47759972,5cyclictest547-21NetworkManager08:57:160
47889960,3cyclictest25188-21ntpq07:55:163
47839966,0cyclictest784-21snmpd10:08:252
47839966,0cyclictest784-21snmpd07:31:292
47839966,0cyclictest782-21lldpd08:03:402
47839965,1cyclictest784-21snmpd09:39:472
47839964,2cyclictest784-21snmpd10:15:272
47839964,2cyclictest784-21snmpd07:17:042
47839962,3cyclictest6406-21systemctl07:10:192
47839962,2cyclictest0-21swapper/211:11:142
47839960,2cyclictest191rcu_preempt07:35:112
47759966,0cyclictest8920-21apt-get10:05:000
47759966,0cyclictest784-21snmpd10:40:260
47759966,0cyclictest784-21snmpd09:08:320
47759964,2cyclictest784-21snmpd07:49:310
47759964,2cyclictest11217-21ssh11:50:200
47759963,2cyclictest8521-21ssh12:23:120
47759963,2cyclictest455-21ssh11:05:070
47759963,2cyclictest31888-21ssh12:13:360
47759963,2cyclictest245-20systemd-journal10:20:530
47759962,3cyclictest4824-21ssh11:10:000
47759962,3cyclictest27706-21ssh11:34:030
47759962,3cyclictest15976-21ld08:50:180
47839953,2cyclictest784-21snmpd07:40:162
47839952,3cyclictest3481-21nvmesmart_nvme008:20:162
47839952,2cyclictest32580-21ssh09:20:072
47839952,2cyclictest25917-21ssh09:47:232
47839952,2cyclictest25225-21ntpq07:55:172
47839952,2cyclictest21255-21ssh12:36:242
47839952,2cyclictest11302-21ssh09:31:002
47839950,2cyclictest14695-21grep11:20:122
47759955,0cyclictest784-21snmpd08:20:320
47759955,0cyclictest784-21snmpd07:10:110
47759955,0cyclictest526-21avahi-daemon08:25:380
47759954,1cyclictest18785-21gltestperf07:40:140
47759953,2cyclictest547-21NetworkManager12:38:080
47759953,2cyclictest5372-21cat10:35:140
47759953,2cyclictest5372-21cat10:35:140
47759953,2cyclictest0-21swapper/009:39:130
47759952,3cyclictest547-21NetworkManager11:00:090
47759952,2cyclictest4209-21ssh10:34:270
47759952,2cyclictest32318-21ssh09:55:000
47759952,2cyclictest30542-21ssh09:17:090
47759952,2cyclictest1264-21ntp_192.168.11408:15:160
47759951,3cyclictest14705-21perl11:20:120
47759951,3cyclictest11163-21seq09:30:460
47839943,1cyclictest784-21snmpd07:20:092
47839940,4cyclictest13845-21ntpq08:45:152
47839940,3cyclictest19481-21fw_forwarded_lo09:00:132
47759940,3cyclictest19745-21memory09:00:140
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional