You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-30 - 00:55

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack8slot6s.osadl.org (updated Sat Aug 29, 2026 12:43:39)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
126059910511049,2cyclictest26557-21kworker/1:2+events10:56:041
126059910511049,2cyclictest26471-21kworker/1:1+events11:18:101
126059910511047,3cyclictest13333-21kworker/1:2+events11:48:401
126159910501049,1cyclictest3124-21kworker/3:1+events08:10:213
126059910501048,2cyclictest26471-21kworker/1:1+events11:20:441
126059910491047,2cyclictest26471-21kworker/1:1+events11:53:581
126059910491047,2cyclictest26471-21kworker/1:1+events11:01:071
126059910491047,2cyclictest19903-21kworker/1:0+events12:28:281
126059910481046,2cyclictest26471-21kworker/1:1+events11:07:111
126109910471046,1cyclictest7761-21kworker/2:0+events07:21:082
126029910471046,1cyclictest27489-21kworker/0:1+events11:40:220
126059910451043,2cyclictest10112-21kworker/1:0+events07:10:551
126159910411040,1cyclictest951-21kworker/3:2+events10:28:503
126059910371036,1cyclictest26557-21kworker/1:2+events10:51:281
126029910331031,2cyclictest30294-21turbostat09:49:550
126109910281026,2cyclictest2495-21turbostat09:54:552
126159910271026,1cyclictest23495-21kworker/3:1+events10:31:503
126159910251024,1cyclictest13779-21kworker/3:0+events10:03:363
126159910231022,1cyclictest1447-21kworker/3:0+events12:09:503
126159910231022,1cyclictest13020-21kworker/3:0+events08:54:433
126029910231021,2cyclictest2347-21turbostat10:29:550
126159910221021,1cyclictest23495-21kworker/3:1+events10:15:223
126029910221021,1cyclictest27489-21kworker/0:1+events11:36:050
126159910191018,1cyclictest6784-21kworker/3:2+events12:12:213
126159910191018,1cyclictest24720-21kworker/3:1+events09:43:523
126159910181017,1cyclictest951-21kworker/3:2+events10:37:423
126159910181017,1cyclictest8905-21kworker/3:2+events08:21:493
126159910181017,1cyclictest24720-21kworker/3:1+events09:39:003
126159910181017,1cyclictest18673-21kworker/3:2+events10:10:433
126159910171016,1cyclictest455-21kworker/3:2+events09:52:233
126159910161015,1cyclictest15517-21kworker/3:0+events10:47:353
126159910151014,1cyclictest455-21kworker/3:2+events09:21:503
126159910151014,1cyclictest11603-21kworker/3:1+events12:19:123
126059910131010,3cyclictest17356-21turbostat08:44:551
126159910091008,1cyclictest17876-21kworker/3:2+events08:08:593
126159910071006,1cyclictest8905-21kworker/3:2+events08:45:543
126159910071006,1cyclictest8905-21kworker/3:2+events08:36:473
126159910071006,1cyclictest7428-21kworker/3:1+events09:58:453
126159910061005,1cyclictest455-21kworker/3:2+events09:17:083
126159910061005,1cyclictest22494-21kworker/3:1+events12:01:363
126159910061005,1cyclictest17876-21kworker/3:2+events07:51:483
126159910061005,1cyclictest14877-21kworker/3:0+events09:31:463
126159910061005,1cyclictest13020-21kworker/3:0+events09:05:223
126159910051004,1cyclictest951-21kworker/3:2+events10:42:123
126159910031002,1cyclictest3124-21kworker/3:1+events08:04:243
126159910021001,1cyclictest25491-21kworker/3:1+events09:11:233
126159910021001,1cyclictest25491-21kworker/3:1+events09:01:483
126159910021001,1cyclictest17876-21kworker/3:2+events07:55:453
126159910021001,1cyclictest13020-21kworker/3:0+events08:59:543
12605991002999,3cyclictest15343-21turbostat08:39:551
126159910011000,1cyclictest951-21kworker/3:2+events11:55:223
126159910011000,1cyclictest8905-21kworker/3:2+events08:16:523
126159910011000,1cyclictest455-21kworker/3:2+events09:25:213
12615991000999,1cyclictest13020-21kworker/3:0+events08:40:223
12615991000999,1cyclictest11603-21kworker/3:1+events12:37:113
1261599997997,0cyclictest23495-21kworker/3:1+events10:20:423
1261599997996,1cyclictest8905-21kworker/3:2+events08:32:553
1261599996995,1cyclictest13779-21kworker/3:0+events10:07:543
1260299994993,1cyclictest20760-21turbostat10:49:550
1261599992990,0cyclictest8905-21kworker/3:2+events08:25:433
1260299991990,1cyclictest30227-21kworker/0:0+events11:27:110
1261099988987,1cyclictest2600-21turbostat09:19:552
1260299981980,1cyclictest28885-21kworker/0:0+events07:47:320
1261099979978,1cyclictest17223-21kworker/2:2+events12:30:542
1260299978975,1cyclictest27489-21kworker/0:1+events11:31:050
1260599970968,2cyclictest29143-21turbostat07:54:551
1260299964963,1cyclictest22655-21kworker/0:1+events07:41:500
1260299962961,1cyclictest22655-21kworker/0:1+events07:37:530
1260599961959,2cyclictest3236-21turbostat08:09:551
1260299959958,1cyclictest22655-21kworker/0:1+events07:33:170
1261599958955,3cyclictest14948-21turbostat07:19:553
1261599957954,3cyclictest22278-21turbostat11:24:563
1260299957954,3cyclictest25671-21turbostat09:44:550
1260299956955,1cyclictest17167-21kworker/0:2+events07:28:060
1260599911910,1cyclictest26471-21kworker/1:1+events11:10:221
1260599909906,3cyclictest27129-21turbostat07:49:551
1260299909907,2cyclictest11305-21turbostat08:29:550
1260299907905,2cyclictest4003-21turbostat12:14:550
1260299895892,2cyclictest19393-21turbostat08:49:550
1261599889886,3cyclictest16959-21turbostat07:24:563
1260599888887,1cyclictest26471-21kworker/1:1+events07:15:231
1260599880877,1cyclictest19903-21kworker/1:0+events12:24:031
1260299880878,2cyclictest22841-21turbostat12:34:550
1261599864862,2cyclictest17675-21turbostat11:19:553
1261599854851,3cyclictest18998-21turbostat07:29:563
1260299854852,2cyclictest18245-21turbostat12:29:550
1260599686683,3cyclictest20760-21turbostat10:49:551
1261099684683,1cyclictest14948-21turbostat07:19:562
1260299661660,1cyclictest22278-21turbostat11:24:550
1260599639638,1cyclictest8758-21turbostat11:44:551
1260599638635,3cyclictest9013-21turbostat12:19:551
1261599636634,2cyclictest30294-21turbostat09:49:553
1261099632628,4cyclictest18245-21turbostat12:29:552
1261599629627,2cyclictest17987-21turbostat11:54:553
1260299593592,1cyclictest16959-21turbostat07:24:550
1261599575574,1cyclictest27129-21turbostat07:49:553
1261599487482,3cyclictest22841-21turbostat12:34:553
12605991918,1cyclictest67750irq/123-lan09:18:371
12605991918,1cyclictest67750irq/123-lan09:10:161
12605991818,0cyclictest67750irq/123-lan09:25:551
12605991817,1cyclictest67750irq/123-lan12:00:161
12605991817,1cyclictest67750irq/123-lan11:34:461
12605991817,1cyclictest67750irq/123-lan11:27:281
12605991817,1cyclictest67750irq/123-lan10:26:541
12605991817,1cyclictest67750irq/123-lan08:50:131
12605991817,1cyclictest67750irq/123-lan08:25:141
12605991717,0cyclictest67750irq/123-lan12:13:591
12605991717,0cyclictest67750irq/123-lan10:39:411
12605991717,0cyclictest67750irq/123-lan10:30:111
12605991717,0cyclictest67750irq/123-lan10:00:481
12605991717,0cyclictest67750irq/123-lan09:20:181
12605991717,0cyclictest67750irq/123-lan08:20:111
12605991717,0cyclictest67750irq/123-lan08:00:131
12605991717,0cyclictest67750irq/123-lan07:30:071
12605991716,1cyclictest67750irq/123-lan12:33:121
12605991716,1cyclictest67750irq/123-lan12:05:131
12605991716,1cyclictest67750irq/123-lan11:55:151
12605991716,1cyclictest67750irq/123-lan10:22:201
12605991716,1cyclictest67750irq/123-lan10:05:071
12605991716,1cyclictest67750irq/123-lan09:45:161
12605991716,1cyclictest67750irq/123-lan09:35:211
12605991716,1cyclictest67750irq/123-lan07:55:171
12605991616,0cyclictest67750irq/123-lan12:35:211
12605991616,0cyclictest67750irq/123-lan09:40:101
12605991615,1cyclictest67750irq/123-lan11:35:181
12605991615,1cyclictest67750irq/123-lan10:17:361
12605991615,1cyclictest67750irq/123-lan10:12:371
12605991615,1cyclictest67750irq/123-lan09:56:051
12605991615,1cyclictest67750irq/123-lan09:54:511
12605991615,1cyclictest67750irq/123-lan09:30:591
12605991615,1cyclictest67750irq/123-lan07:20:161
12605991514,1cyclictest67750irq/123-lan10:40:171
12605991514,1cyclictest67750irq/123-lan09:05:211
12605991514,1cyclictest67750irq/123-lan09:00:001
12605991514,1cyclictest67750irq/123-lan08:13:221
12605991514,1cyclictest67750irq/123-lan07:43:071
12605991414,0cyclictest67750irq/123-lan08:32:071
12605991413,1cyclictest67750irq/123-lan08:46:071
12605991212,0cyclictest67750irq/123-lan07:39:251
12610991110,1cyclictest762-21ntpd10:16:472
12605991111,0cyclictest67750irq/123-lan07:25:211
1260599109,1cyclictest67750irq/123-lan09:00:171
12605991010,0cyclictest67750irq/123-lan08:15:191
126159998,1cyclictest784-21snmpd11:25:003
126109998,1cyclictest784-21snmpd08:07:292
126109998,1cyclictest784-21snmpd07:52:022
126029999,0cyclictest30227-21kworker/0:0+events_freezable11:12:240
126159988,0cyclictest784-21snmpd11:36:313
126159988,0cyclictest782-21lldpd11:46:403
126159988,0cyclictest782-21lldpd07:42:193
126159986,2cyclictest762-21ntpd07:35:463
126159984,3cyclictest12594-21cyclictest11:01:473
126109988,0cyclictest784-21snmpd11:00:162
126109988,0cyclictest784-21snmpd10:50:342
126109988,0cyclictest784-21snmpd10:38:032
126109988,0cyclictest784-21snmpd10:11:272
126109988,0cyclictest784-21snmpd09:23:222
126109988,0cyclictest782-21lldpd10:04:192
126109987,1cyclictest784-21snmpd07:58:132
126109987,1cyclictest526-21avahi-daemon11:18:512
126109986,2cyclictest784-21snmpd09:25:192
126109986,2cyclictest784-21snmpd08:49:482
126109986,2cyclictest762-21ntpd09:37:212
126109986,2cyclictest762-21ntpd09:31:292
126109986,2cyclictest762-21ntpd08:10:222
126029988,0cyclictest782-21lldpd11:47:520
126029988,0cyclictest782-21lldpd10:02:130
126029988,0cyclictest782-21lldpd09:36:300
126029988,0cyclictest782-21lldpd08:09:170
126029987,1cyclictest784-21snmpd08:34:030
126029987,1cyclictest507-21systemd-resolve11:53:250
126029987,1cyclictest16368-21ntp_kernel_pll_08:35:180
126029986,2cyclictest784-21snmpd12:05:500
126029986,2cyclictest784-21snmpd10:41:390
126029986,2cyclictest784-21snmpd09:03:580
126029986,2cyclictest784-21snmpd07:16:490
126159977,0cyclictest784-21snmpd11:41:043
126159977,0cyclictest782-21lldpd11:34:543
126159976,1cyclictest784-21snmpd10:52:253
126159976,0cyclictest191rcu_preempt10:56:433
126159975,2cyclictest762-21ntpd07:34:193
126159972,3cyclictest13916-21ntpq07:10:163
126109977,0cyclictest784-21snmpd11:10:222
126109977,0cyclictest784-21snmpd10:57:042
126109977,0cyclictest784-21snmpd10:30:392
126109977,0cyclictest784-21snmpd10:06:022
126109977,0cyclictest782-21lldpd12:36:392
126109977,0cyclictest782-21lldpd12:24:132
126109977,0cyclictest782-21lldpd11:42:492
126109977,0cyclictest782-21lldpd11:35:162
126109977,0cyclictest782-21lldpd07:45:412
126109977,0cyclictest782-21lldpd07:28:312
126109976,1cyclictest784-21snmpd08:16:252
126109976,1cyclictest762-21ntpd11:48:432
126109976,1cyclictest507-21systemd-resolve08:59:092
126109975,2cyclictest784-21snmpd08:00:052
126109975,2cyclictest762-21ntpd12:16:472
126109975,2cyclictest762-21ntpd10:49:502
126109975,2cyclictest762-21ntpd10:40:262
126109975,2cyclictest762-21ntpd10:28:172
126109975,2cyclictest762-21ntpd09:47:272
126029977,0cyclictest784-21snmpd08:22:590
126029977,0cyclictest784-21snmpd07:55:590
126029977,0cyclictest784-21snmpd07:51:170
126029976,1cyclictest784-21snmpd08:42:330
126029976,1cyclictest782-21lldpd11:17:460
126029976,1cyclictest526-21avahi-daemon10:53:280
126029976,1cyclictest507-21systemd-resolve09:32:470
126029975,2cyclictest784-21snmpd09:58:500
126029975,2cyclictest784-21snmpd08:57:270
126029975,2cyclictest1916-21cat08:00:150
126029974,2cyclictest245-20systemd-journal09:51:550
126159965,0cyclictest191rcu_preempt12:25:053
126159963,1cyclictest52-21ksoftirqd/311:05:203
126159961,3cyclictest52-21ksoftirqd/312:25:003
126109966,0cyclictest784-21snmpd09:43:532
126109966,0cyclictest784-21snmpd07:43:132
126109966,0cyclictest784-21snmpd07:14:432
126109966,0cyclictest782-21lldpd11:26:302
126109966,0cyclictest782-21lldpd09:09:422
126109965,1cyclictest784-21snmpd08:37:182
126109965,1cyclictest762-21ntpd08:20:142
126109964,2cyclictest784-21snmpd12:03:212
126109964,2cyclictest784-21snmpd11:53:132
126109964,2cyclictest784-21snmpd08:26:572
126109964,2cyclictest762-21ntpd12:07:392
126109964,2cyclictest762-21ntpd11:34:002
126109964,2cyclictest762-21ntpd11:05:122
126109964,2cyclictest762-21ntpd10:22:412
126109964,2cyclictest762-21ntpd09:55:192
126109964,2cyclictest762-21ntpd09:10:452
126109963,3cyclictest21805-21cut08:50:142
126029966,0cyclictest784-21snmpd11:09:080
126029965,1cyclictest784-21snmpd09:26:250
126029964,2cyclictest784-21snmpd08:13:320
126029963,3cyclictest547-21NetworkManager08:54:110
126029963,3cyclictest1696-21ssh09:13:310
126029963,2cyclictest9712-21ssh09:21:240
126029963,2cyclictest245-20systemd-journal12:22:130
126029963,2cyclictest14463-21grep07:10:210
126029963,0cyclictest0-21swapper/010:23:470
126029962,3cyclictest6023-21ssh09:18:000
126029962,3cyclictest13682-21ssh10:35:540
126159954,0cyclictest191rcu_preempt11:10:173
126109955,0cyclictest784-21snmpd08:41:122
126109955,0cyclictest782-21lldpd11:20:162
126109954,1cyclictest762-21ntpd11:55:372
126109950,4cyclictest5523-21ntp_192.168.11412:10:152
126029955,0cyclictest782-21lldpd11:00:090
126029953,2cyclictest762-21ntpd10:30:240
126029953,2cyclictest28269-21cat12:35:150
126029953,2cyclictest0-21swapper/012:00:480
126029952,2cyclictest845-21ssh10:56:220
126029952,2cyclictest25851-21ssh10:15:120
126029952,2cyclictest24956-21ssh11:56:180
126029952,2cyclictest245-20systemd-journal08:15:180
126029952,2cyclictest17050-21sh10:05:160
126029952,2cyclictest11464-21ssh12:16:250
126029951,3cyclictest22129-21ntpq10:10:160
126109941,2cyclictest26906-21ld09:00:172
126109941,2cyclictest14922-21sed08:30:202
126109940,4cyclictest21980-21ntpq07:30:152
126109940,3cyclictest24074-21collect207:35:162
126029940,3cyclictest28451-21fw_forwarded_lo09:05:140
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional