You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-25 - 04:44

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack8slot6s.osadl.org (updated Tue Aug 25, 2026 00:43:39)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
48609910511049,2cyclictest6997-21kworker/2:1+events23:31:492
48549910511049,2cyclictest21483-21kworker/0:0+events21:48:470
48609910501047,3cyclictest22565-21turbostat00:24:552
48589910501048,2cyclictest10517-21kworker/1:1+events20:08:431
48609910471045,2cyclictest11323-21kworker/2:0+events23:40:332
48609910471044,3cyclictest32638-21kworker/2:1+events22:28:072
48609910441043,1cyclictest32638-21kworker/2:1+events22:30:322
48609910441042,2cyclictest11323-21kworker/2:0+events23:35:522
48589910421041,1cyclictest32221-21kworker/1:1+events22:58:391
48549910421040,2cyclictest3383-21kworker/0:3+events00:07:330
48549910411039,2cyclictest26542-21kworker/0:1+events21:58:110
48609910401039,1cyclictest19695-21kworker/2:0+events22:16:492
48549910391036,2cyclictest13266-21kworker/0:1+events20:52:330
48589910381037,1cyclictest31070-21kworker/1:1+events23:56:531
48549910381036,2cyclictest17916-21kworker/0:1+events20:39:420
48589910371035,2cyclictest14669-21kworker/1:0+events22:54:491
48549910371035,2cyclictest21483-21kworker/0:0+events21:50:230
48549910361034,2cyclictest29711-21kworker/0:0+events20:16:380
48549910361034,2cyclictest21483-21kworker/0:0+events21:11:280
48549910361034,2cyclictest15301-21kworker/0:2+events21:07:350
48689910351034,1cyclictest13136-21kworker/3:0+events21:44:203
48589910351034,1cyclictest32221-21kworker/1:1+events23:05:451
48549910351032,3cyclictest29711-21kworker/0:0+events20:14:270
48689910331031,2cyclictest29066-21turbostat23:24:553
48549910331031,2cyclictest17916-21kworker/0:1+events20:26:380
48549910321030,2cyclictest9844-21kworker/0:0+events20:40:310
48549910321030,2cyclictest29711-21kworker/0:0+events20:20:210
48689910301029,1cyclictest9288-21kworker/3:2+events22:01:293
48549910301028,2cyclictest13266-21kworker/0:1+events20:58:310
48549910301027,3cyclictest13266-21kworker/0:1+events21:02:350
48689910291028,1cyclictest5534-21kworker/3:2+events21:19:503
48549910281026,2cyclictest9844-21kworker/0:0+events20:46:280
48549910281025,3cyclictest15787-21turbostat21:39:550
48549910271024,3cyclictest3383-21kworker/0:3+events00:00:440
48689910261024,2cyclictest30298-21turbostat23:59:553
48689910231022,1cyclictest1632-21kworker/3:0+events21:24:553
48689910181016,2cyclictest5534-21kworker/3:2+events20:32:473
48589910171016,1cyclictest10517-21kworker/1:1+events22:36:081
48589910161015,1cyclictest17200-21kworker/1:2+events23:27:291
48689910121009,3cyclictest8650-21turbostat22:34:553
48589910121010,2cyclictest10517-21kworker/1:1+events22:42:561
48549910071005,2cyclictest18735-21turbostat00:19:550
48589910041002,2cyclictest411-21kworker/1:2+events19:14:311
48589910031003,0cyclictest26733-21kworker/1:2+events22:49:001
48589910031001,2cyclictest22811-21kworker/1:0+events23:17:131
48589910031001,2cyclictest17200-21kworker/1:2+events23:21:581
48689910021001,1cyclictest13136-21kworker/3:0+events21:36:593
4868991000998,2cyclictest12856-21kworker/3:0+events19:38:373
4858991000999,1cyclictest411-21kworker/1:2+events19:15:211
486899999997,2cyclictest13136-21kworker/3:0+events21:33:053
486899998997,1cyclictest27684-21kworker/3:1+events00:27:113
485899998997,1cyclictest411-21kworker/1:2+events19:26:061
485899998997,1cyclictest32221-21kworker/1:1+events23:01:491
486899996994,2cyclictest27433-21turbostat20:09:553
486899996994,2cyclictest2548-21kworker/3:2+pm00:33:383
486099996994,1cyclictest32638-21kworker/2:1+events22:24:242
486899995994,1cyclictest20608-21kworker/3:0+events19:47:563
485899995994,1cyclictest32221-21kworker/1:1+events23:13:201
485899994993,1cyclictest10517-21kworker/1:1+events19:21:581
486899991990,1cyclictest12856-21kworker/3:0+events19:40:203
486899990989,1cyclictest18564-21kworker/3:2+events19:56:283
486899989988,1cyclictest18564-21kworker/3:2+events19:54:203
486099989988,1cyclictest19695-21kworker/2:0+events22:11:292
486099984982,2cyclictest19719-21kworker/2:2+events23:50:522
486899974972,2cyclictest15651-21turbostat20:59:553
486899972971,1cyclictest14943-21kworker/3:1+events22:08:373
485499963961,2cyclictest16913-21turbostat19:44:540
485499962959,3cyclictest6811-21turbostat19:19:550
486899959958,1cyclictest19089-21kworker/3:0+events00:17:423
486899959956,3cyclictest1878-21turbostat23:29:543
486899956955,1cyclictest19089-21kworker/3:0+events00:37:403
486899956955,1cyclictest13463-21kworker/3:2+events00:13:353
485899956953,3cyclictest3413-21turbostat22:29:561
486899955954,1cyclictest18564-21kworker/3:2+events20:00:203
486899954953,1cyclictest26857-21kworker/3:1+events21:29:313
486899954953,1cyclictest19089-21kworker/3:0+events00:22:323
486899950949,1cyclictest18178-21kworker/3:2+events19:34:003
486099946943,3cyclictest4177-21turbostat21:59:552
485499942939,3cyclictest10155-21turbostat21:34:560
485899939937,2cyclictest14575-21turbostat22:09:561
486099922920,2cyclictest3534-21turbostat20:29:552
485899916913,3cyclictest5772-21turbostat00:39:551
486099914913,1cyclictest19719-21kworker/2:2+events23:45:422
486899913910,3cyclictest9583-21turbostat20:44:553
485899883881,2cyclictest20963-21turbostat21:44:561
485499882880,2cyclictest26478-21turbostat23:54:540
486899866864,2cyclictest24237-21turbostat22:49:553
486899854852,2cyclictest7573-21turbostat20:39:553
486899690689,1cyclictest21715-21turbostat21:14:553
485899689688,1cyclictest25414-21turbostat20:04:551
486899684681,3cyclictest10871-21turbostat19:29:543
486099676675,1cyclictest1878-21turbostat23:29:542
485499672668,4cyclictest20963-21turbostat21:44:550
485499672668,3cyclictest30298-21turbostat23:59:550
485499642638,4cyclictest27433-21turbostat20:09:550
485899624622,2cyclictest8650-21turbostat22:34:551
486899613612,1cyclictest8341-21turbostat00:09:543
485899606603,3cyclictest26478-21turbostat23:54:541
486099600598,2cyclictest14575-21turbostat22:09:562
485499539535,4cyclictest5564-21turbostat20:34:560
486899536534,2cyclictest4177-21turbostat21:59:553
486899512511,1cyclictest3534-21turbostat20:29:563
4858992020,0cyclictest31395-21kworker/1:0+events_freezable00:10:351
4858992020,0cyclictest10517-21kworker/1:1+events_freezable21:53:421
4858991919,0cyclictest31395-21kworker/1:0+events_freezable00:31:081
4858991919,0cyclictest10517-21kworker/1:1+events_freezable21:35:191
4858991919,0cyclictest10517-21kworker/1:1+events_freezable21:33:571
4858991918,1cyclictest31395-21kworker/1:0+events00:05:281
4858991818,0cyclictest67750irq/123-lan22:11:271
4858991818,0cyclictest67750irq/123-lan21:18:051
4858991818,0cyclictest67750irq/123-lan21:10:121
4858991818,0cyclictest67750irq/123-lan20:47:021
4858991818,0cyclictest67750irq/123-lan20:25:061
4858991818,0cyclictest67750irq/123-lan19:40:131
4858991818,0cyclictest67750irq/123-lan00:21:351
4858991818,0cyclictest31070-21kworker/1:1+events_freezable23:49:441
4858991817,1cyclictest67750irq/123-lan21:25:111
4858991817,1cyclictest67750irq/123-lan20:30:151
4858991717,0cyclictest784-21snmpd22:21:461
4858991717,0cyclictest784-21snmpd21:06:351
4858991717,0cyclictest784-21snmpd19:49:101
4858991717,0cyclictest67750irq/123-lan21:20:171
4858991717,0cyclictest67750irq/123-lan00:25:221
4858991717,0cyclictest67750irq/123-lan00:00:351
4858991717,0cyclictest16337-21cat20:55:131
4858991716,1cyclictest67750irq/123-lan23:43:551
4858991716,1cyclictest67750irq/123-lan23:30:151
4858991716,1cyclictest67750irq/123-lan22:18:271
4858991716,1cyclictest67750irq/123-lan19:38:441
4858991716,1cyclictest67750irq/123-lan00:15:251
4858991616,0cyclictest67750irq/123-lan23:35:271
4858991616,0cyclictest67750irq/123-lan21:45:181
4858991616,0cyclictest67750irq/123-lan20:36:591
4858991616,0cyclictest67750irq/123-lan20:20:081
4858991616,0cyclictest67750irq/123-lan20:16:581
4858991615,1cyclictest67750irq/123-lan22:00:131
4858991615,1cyclictest67750irq/123-lan21:55:121
4858991615,1cyclictest67750irq/123-lan20:00:011
4858991515,0cyclictest67750irq/123-lan20:50:171
4858991515,0cyclictest67750irq/123-lan19:51:521
4858991515,0cyclictest67750irq/123-lan19:30:151
4858991414,0cyclictest67750irq/123-lan20:40:171
4858991313,0cyclictest67750irq/123-lan21:04:101
4858991312,1cyclictest67750irq/123-lan20:10:171
48609998,1cyclictest782-21lldpd00:04:172
48689988,0cyclictest784-21snmpd23:11:203
48689988,0cyclictest784-21snmpd21:08:053
48689988,0cyclictest782-21lldpd23:04:503
48689988,0cyclictest782-21lldpd22:54:533
48689988,0cyclictest782-21lldpd22:43:333
48689987,1cyclictest782-21lldpd19:15:373
48689986,2cyclictest784-21snmpd21:02:353
48609988,0cyclictest784-21snmpd23:59:232
48609988,0cyclictest784-21snmpd00:30:362
48609988,0cyclictest782-21lldpd22:37:272
48609988,0cyclictest782-21lldpd21:31:152
48609988,0cyclictest782-21lldpd19:29:202
48609987,1cyclictest782-21lldpd19:42:442
48609986,2cyclictest784-21snmpd21:40:062
48609986,2cyclictest784-21snmpd00:36:392
48609985,2cyclictest784-21snmpd21:25:082
48549987,1cyclictest784-21snmpd00:25:080
48549986,2cyclictest784-21snmpd19:46:430
48549986,2cyclictest784-21snmpd19:29:060
48689977,0cyclictest784-21snmpd23:43:193
48689977,0cyclictest784-21snmpd23:09:503
48689977,0cyclictest784-21snmpd20:50:213
48689977,0cyclictest782-21lldpd22:11:463
48689976,1cyclictest526-21avahi-daemon22:19:223
48689976,1cyclictest17459-21latency_hist23:40:003
48689975,2cyclictest784-21snmpd23:31:583
48689975,2cyclictest784-21snmpd22:56:213
48689975,2cyclictest784-21snmpd22:37:143
48689975,2cyclictest784-21snmpd20:14:453
48689974,2cyclictest245-20systemd-journal00:00:213
48609977,0cyclictest784-21snmpd20:51:462
48609977,0cyclictest784-21snmpd19:30:462
48609977,0cyclictest784-21snmpd19:12:312
48609977,0cyclictest784-21snmpd00:27:442
48609977,0cyclictest782-21lldpd22:48:502
48609977,0cyclictest782-21lldpd00:18:172
48609977,0cyclictest782-21lldpd00:12:412
48609976,1cyclictest782-21lldpd23:11:052
48609976,1cyclictest526-21avahi-daemon21:20:162
48609975,2cyclictest784-21snmpd23:20:462
48609975,2cyclictest784-21snmpd21:51:142
48609975,2cyclictest784-21snmpd21:49:422
48609975,2cyclictest784-21snmpd20:38:572
48609975,2cyclictest15601-21cat19:35:142
48609974,2cyclictest245-20systemd-journal20:15:192
48609973,3cyclictest9946-21ntp_states19:20:172
48549977,0cyclictest784-21snmpd23:35:310
48549977,0cyclictest784-21snmpd22:44:230
48549977,0cyclictest784-21snmpd00:14:310
48549977,0cyclictest782-21lldpd23:40:300
48549977,0cyclictest782-21lldpd22:03:230
48549977,0cyclictest782-21lldpd19:56:190
48549975,2cyclictest784-21snmpd23:05:300
48549975,2cyclictest784-21snmpd22:56:320
48549975,2cyclictest784-21snmpd21:25:350
48549975,2cyclictest784-21snmpd19:53:290
48549975,2cyclictest784-21snmpd19:32:280
48549973,3cyclictest5349-21fw_conntrack19:10:120
48549972,5cyclictest547-21NetworkManager21:21:460
48689966,0cyclictest782-21lldpd20:17:543
48689965,1cyclictest784-21snmpd20:45:193
48689965,1cyclictest784-21snmpd20:22:473
48689965,1cyclictest782-21lldpd19:22:383
48689964,2cyclictest784-21snmpd22:26:463
48689964,2cyclictest784-21snmpd21:51:473
48689964,2cyclictest784-21snmpd21:48:393
48689964,2cyclictest547-21NetworkManager23:46:243
48689963,3cyclictest245-20systemd-journal23:53:193
48609966,0cyclictest784-21snmpd22:02:522
48609966,0cyclictest526-21avahi-daemon19:17:442
48609965,1cyclictest784-21snmpd20:34:132
48609965,1cyclictest784-21snmpd20:07:142
48609965,1cyclictest782-21lldpd23:17:282
48609965,1cyclictest21284-21cpuspeed_turbos19:50:122
48609965,1cyclictest18240-21gltestperf21:00:142
48609965,1cyclictest17130-21pmu-power21:35:182
48609963,2cyclictest574-21rs:main2
48609963,2cyclictest245-20systemd-journal23:05:142
48549966,0cyclictest784-21snmpd23:03:390
48549966,0cyclictest782-21lldpd23:31:390
48549965,1cyclictest784-21snmpd22:37:520
48549965,1cyclictest25334-21needreboot22:45:170
48549964,2cyclictest784-21snmpd20:00:400
48549963,3cyclictest22911-21ssh00:20:080
48549963,3cyclictest1232-21ssh23:24:080
48549963,2cyclictest32180-21ssh22:51:370
48549963,2cyclictest31430-21ssh22:20:150
48549963,2cyclictest245-20systemd-journal23:25:290
48549963,2cyclictest21858-21ssh22:10:410
48549963,2cyclictest19825-21ntpq23:10:150
48549963,2cyclictest14889-21ssh22:05:090
48549962,3cyclictest9693-21sed19:20:150
48549962,3cyclictest7473-21ssh22:28:230
48549962,3cyclictest29421-21ssh21:16:150
48549962,3cyclictest12037-21ssh22:32:290
48549960,5cyclictest24629-21ssh23:47:260
48689954,1cyclictest31456-21cat22:20:153
48689953,2cyclictest762-21ntpd23:15:083
48689950,2cyclictest55272kernelversion19:10:153
48609954,1cyclictest19275-21cpuspeed_turbos19:45:122
48609953,2cyclictest784-21snmpd20:41:182
48609952,2cyclictest574-21rs:main2
48609952,2cyclictest5698-21ssh22:57:372
48609952,2cyclictest31973-21ssh22:51:192
48609952,2cyclictest245-20systemd-journal19:58:352
48609952,2cyclictest22826-21ssh21:10:152
48609951,3cyclictest20787-21sh21:05:172
48609950,4cyclictest9010-21ntpq23:00:182
48549954,1cyclictest6115-21/usr/sbin/munin00:35:180
48549954,1cyclictest526-21avahi-daemon19:36:380
48549952,3cyclictest1329-21head00:30:140
48549952,2cyclictest26094-21sh22:15:140
48549952,2cyclictest24932-21grep23:15:170
48609944,0cyclictest782-21lldpd20:49:142
48609942,2cyclictest784-21snmpd22:40:412
48609942,2cyclictest784-21snmpd21:15:012
48609942,2cyclictest574-21rs:main2
48609941,2cyclictest1983-21cut20:20:132
48609940,3cyclictest30181-21uname20:10:162
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional