You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-09 - 06:36

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Sat May 09, 2026 00:44:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2440899270,26cyclictest0-21swapper/321:35:363
24400992726,1cyclictest14163-21kworker/1:123:36:031
24408992623,3cyclictest0-21swapper/322:35:243
2440899260,25cyclictest26667-21sh22:14:363
2440899260,25cyclictest0-21swapper/321:30:013
2440899260,25cyclictest0-21swapper/300:21:383
2440899260,22cyclictest0-21swapper/322:30:463
24408992521,3cyclictest0-21swapper/300:32:253
24408992520,4cyclictest0-21swapper/323:46:413
24408992520,4cyclictest0-21swapper/322:01:453
24408992518,4cyclictest18043-21diskmemload00:16:573
24408992517,4cyclictest29830-21sh23:42:123
2440899250,24cyclictest0-21swapper/323:36:063
2440899250,24cyclictest0-21swapper/300:07:363
2440899250,21cyclictest29769-21ssh22:46:323
2440899250,1cyclictest0-21swapper/321:52:243
2440899250,0cyclictest18043-21diskmemload22:06:413
2440899250,0cyclictest0-21swapper/321:46:433
24405992523,1cyclictest0-21swapper/223:09:122
24405992519,1cyclictest12215-21ssh22:30:382
2440599250,24cyclictest18043-21diskmemload21:49:342
2440599250,24cyclictest0-21swapper/222:51:432
24400992524,0cyclictest0-21swapper/122:32:221
2439699250,24cyclictest0-21swapper/023:26:400
24408992422,1cyclictest0-21swapper/321:20:253
24408992420,3cyclictest18043-21diskmemload23:20:223
24408992420,3cyclictest0-21swapper/323:31:033
24408992419,4cyclictest18043-21diskmemload22:58:403
2440899240,24cyclictest0-21swapper/323:18:273
2440899240,24cyclictest0-21swapper/323:06:393
2440899240,23cyclictest18043-21diskmemload23:26:303
2440899240,23cyclictest0-21swapper/321:56:413
2440899240,0cyclictest0-21swapper/323:12:283
2440899240,0cyclictest0-21swapper/322:16:073
2440899240,0cyclictest0-21swapper/300:00:223
24405992423,0cyclictest0-21swapper/223:26:402
24405992422,1cyclictest7125-21sh21:28:012
2440599240,23cyclictest18043-21diskmemload23:36:402
2440599240,23cyclictest0-21swapper/220:41:382
24400992424,0cyclictest0-21swapper/122:42:581
24400992424,0cyclictest0-21swapper/100:07:421
2440099240,24cyclictest0-21swapper/122:14:361
2440099240,23cyclictest5157-21munin-plugin-st23:50:011
2440099240,23cyclictest3632-1kworker/u9:123:22:421
2440099240,23cyclictest18043-21diskmemload00:10:201
2440099240,23cyclictest0-21swapper/123:04:471
2440099240,23cyclictest0-21swapper/122:36:471
2440099240,0cyclictest18043-21diskmemload23:05:251
2440099240,0cyclictest0-21swapper/121:46:161
24396992424,0cyclictest18043-21diskmemload23:10:380
24396992423,1cyclictest18043-21diskmemload00:31:440
24396992422,1cyclictest0-21swapper/000:06:390
2439699240,24cyclictest0-21swapper/021:41:390
2439699240,24cyclictest0-21swapper/021:10:360
2439699240,24cyclictest0-21swapper/000:19:360
2439699240,23cyclictest6258-21ssh23:51:140
2439699240,23cyclictest14160-21sh00:25:530
2439699240,0cyclictest0-21swapper/022:19:260
24408992323,0cyclictest18043-21diskmemload22:50:263
24408992321,1cyclictest0-21swapper/322:20:143
24408992320,3cyclictest0-21swapper/300:26:363
24408992320,2cyclictest0-21swapper/323:55:383
24408992318,4cyclictest18043-21diskmemload21:41:403
2440899230,23cyclictest0-21swapper/322:40:173
2440899230,23cyclictest0-21swapper/322:26:243
2440899230,22cyclictest8587-21ssh23:51:573
2440899230,20cyclictest0-21swapper/323:02:003
2440899230,20cyclictest0-21swapper/321:10:543
2440899230,1cyclictest28287-21ssh00:37:273
2440899230,0cyclictest0-21swapper/321:17:173
24405992323,0cyclictest18043-21diskmemload23:30:382
24405992323,0cyclictest18043-21diskmemload22:23:292
24405992323,0cyclictest0-21swapper/223:51:132
24405992323,0cyclictest0-21swapper/221:56:042
24405992323,0cyclictest0-21swapper/221:36:212
24405992321,1cyclictest0-21swapper/200:36:402
24405992321,1cyclictest0-21swapper/200:06:472
24405992320,2cyclictest18043-21diskmemload21:50:312
24405992318,1cyclictest6067-21sh00:17:592
2440599230,2cyclictest30984-21ssh21:21:272
2440599230,2cyclictest27596-21sh22:43:542
2440599230,22cyclictest23009-21ssh00:32:532
2440599230,22cyclictest19728-21ssh21:11:312
2440599230,22cyclictest10933-21rm22:57:152
2440599230,1cyclictest606-21dbus-daemon21:35:002
2440599230,1cyclictest4505-21ssh23:20:572
2440599230,1cyclictest18043-21diskmemload23:49:002
2440599230,1cyclictest0-21swapper/222:08:492
2440599230,0cyclictest0-21swapper/222:17:062
24400992323,0cyclictest0-21swapper/123:57:461
24400992323,0cyclictest0-21swapper/123:52:061
24400992323,0cyclictest0-21swapper/123:25:121
24400992323,0cyclictest0-21swapper/122:21:151
24400992323,0cyclictest0-21swapper/121:54:391
24400992323,0cyclictest0-21swapper/121:35:211
24400992323,0cyclictest0-21swapper/121:25:301
24400992322,0cyclictest0-21swapper/122:45:051
24400992320,2cyclictest9061-21cstates22:56:411
2440099230,23cyclictest0-21swapper/121:11:141
2440099230,22cyclictest8841-21ssh00:21:261
2440099230,22cyclictest30119-21sh21:20:171
2440099230,22cyclictest26021-21sh20:20:001
2440099230,22cyclictest24673-21ssh21:15:341
2440099230,22cyclictest18229-21sh00:01:281
2440099230,1cyclictest0-21swapper/122:15:441
2440099230,0cyclictest0-21swapper/123:15:261
2440099230,0cyclictest0-21swapper/122:07:211
2440099230,0cyclictest0-21swapper/122:02:221
2440099230,0cyclictest0-21swapper/121:57:091
24396992323,0cyclictest18043-21diskmemload22:11:180
24396992323,0cyclictest18043-21diskmemload21:54:300
24396992323,0cyclictest0-21swapper/022:22:170
24396992322,1cyclictest4503-21ssh23:49:040
24396992321,2cyclictest0-21swapper/022:42:150
24396992321,1cyclictest6408-21cron19:40:010
24396992321,1cyclictest0-21swapper/023:20:130
24396992321,1cyclictest0-21swapper/023:06:100
24396992321,1cyclictest0-21swapper/021:15:320
2439699230,23cyclictest62550irq/127-eno122:01:200
2439699230,23cyclictest0-21swapper/022:58:590
2439699230,23cyclictest0-21swapper/022:05:570
2439699230,23cyclictest0-21swapper/000:36:140
2439699230,23cyclictest0-21swapper/000:10:550
2439699230,22cyclictest24003-21ssh23:36:550
2439699230,22cyclictest18043-21diskmemload21:26:050
2439699230,22cyclictest15207-21sh23:30:060
2439699230,22cyclictest0-21swapper/023:17:310
2439699230,1cyclictest17702-21sh21:36:580
2439699230,0cyclictest18043-21diskmemload21:30:340
2439699230,0cyclictest0-21swapper/021:22:380
2439699230,0cyclictest0-21swapper/000:21:070
24408992219,3cyclictest0-21swapper/321:31:043
24408992219,2cyclictest30869-21perf20:30:013
24408992219,2cyclictest30869-21perf20:30:013
2440899220,21cyclictest0-21swapper/320:31:383
2440899220,1cyclictest28679-21ssh00:10:183
24405992222,0cyclictest18043-21diskmemload23:41:092
24405992222,0cyclictest18043-21diskmemload23:10:382
24405992222,0cyclictest18043-21diskmemload00:10:552
24405992222,0cyclictest0-21swapper/200:21:352
24405992221,0cyclictest11466-21apt-get23:55:022
24405992220,2cyclictest10793-21ssh22:00:332
24405992220,1cyclictest28859-21apt-get20:26:392
24405992220,1cyclictest28859-21apt-get20:26:392
24405992220,1cyclictest18485-21cut21:10:012
24405992220,1cyclictest0-21swapper/222:35:282
24405992219,2cyclictest6258-21ssh22:25:102
2440599220,22cyclictest0-21swapper/223:15:182
2440599220,22cyclictest0-21swapper/221:40:262
2440599220,22cyclictest0-21swapper/221:15:142
2440599220,21cyclictest13258-21turbostat.cron21:00:002
2440599220,1cyclictest3267-21idleruntime-cro20:40:012
2440599220,1cyclictest29239-21ssh22:45:442
2440599220,1cyclictest21037-21ssh00:02:462
2440599220,1cyclictest18043-21diskmemload00:27:102
2440599220,1cyclictest0-21swapper/223:00:102
2440599220,0cyclictest18043-21diskmemload22:10:412
24400992222,0cyclictest0-21swapper/123:40:091
24400992222,0cyclictest0-21swapper/122:26:271
24400992221,0cyclictest0-21swapper/120:21:381
24400992220,1cyclictest0-21swapper/119:20:001
2440099220,2cyclictest23354-21diskmemload21:42:011
2440099220,21cyclictest1988-21apt-get19:31:371
2440099220,21cyclictest18043-21diskmemload23:30:151
2440099220,21cyclictest0-21swapper/121:30:141
2440099220,21cyclictest0-21swapper/119:36:381
2440099220,1cyclictest2834-21sh22:51:201
2440099220,1cyclictest18420-21apt20:05:001
2440099220,1cyclictest13681-21ssh00:25:181
2440099220,1cyclictest0-21swapper/100:15:011
24396992222,0cyclictest0-21swapper/023:43:170
24396992222,0cyclictest0-21swapper/022:51:370
24396992222,0cyclictest0-21swapper/000:02:140
24396992221,1cyclictest0-21swapper/021:48:130
24396992219,2cyclictest18475-21dpkg21:10:010
2439699220,22cyclictest0-21swapper/023:01:060
2439699220,21cyclictest5220-21diskmemload21:55:500
2439699220,21cyclictest20613-21ssh22:37:110
2439699220,21cyclictest14275-21sed23:56:480
2439699220,21cyclictest0-21swapper/022:25:360
2439699220,21cyclictest0-21swapper/020:55:020
2439699220,1cyclictest0-21swapper/022:31:410
24408992120,0cyclictest32005-21apt-get19:26:383
24408992119,1cyclictest5678-21cron20:45:013
24408992119,1cyclictest23602-21turbostat20:15:003
24408992119,1cyclictest18085-21idleruntime-cro21:10:013
2440899210,20cyclictest0-21swapper/320:51:383
2440899210,0cyclictest0-21swapper/320:16:393
2440599210,20cyclictest0-21swapper/220:11:372
2440599210,20cyclictest0-21swapper/219:16:382
24400992120,1cyclictest31256-21apt-get20:31:381
2440099210,21cyclictest0-21swapper/123:10:111
2440099210,0cyclictest18043-21diskmemload00:30:051
24396992121,0cyclictest0-21swapper/019:31:370
2439699210,21cyclictest0-21swapper/019:21:380
2439699210,1cyclictest21430-21apt-get20:10:020
2439699210,0cyclictest0-21swapper/019:11:360
24408992020,0cyclictest0-21swapper/320:56:393
24405992020,0cyclictest0-21swapper/220:06:382
24405992018,1cyclictest26035-21cut20:20:002
24405992018,1cyclictest15982-21sh20:00:002
2440599200,0cyclictest0-21swapper/219:11:362
24400992020,0cyclictest6053-21apt-get20:46:371
24400992020,0cyclictest3659-21apt-get20:41:381
24400992020,0cyclictest0-21swapper/119:26:381
24400992020,0cyclictest0-21swapper/119:21:381
2440099200,20cyclictest0-21swapper/120:06:381
24408991919,0cyclictest0-21swapper/319:31:373
24408991917,1cyclictest29609-21apt-get19:21:383
24408991917,1cyclictest0-21swapper/319:46:393
24408991916,2cyclictest20812-21turbostat.cron20:10:003
24405991919,0cyclictest0-21swapper/220:01:382
24405991919,0cyclictest0-21swapper/219:21:382
2440099195,14cyclictest2788-21kworker/1:119:42:351
24400991919,0cyclictest13987-21apt-get19:56:381
24400991919,0cyclictest0-21swapper/120:56:391
24396991919,0cyclictest0-21swapper/019:56:380
24396991918,1cyclictest6806-21apt-get19:41:390
24396991916,2cyclictest3279-21apt20:40:010
2439699190,1cyclictest8449-21apt-get20:51:380
24408991817,1cyclictest13617-21perf19:55:013
24405991818,0cyclictest9199-21apt-get19:46:392
24405991818,0cyclictest0-21swapper/219:51:392
24400991818,0cyclictest0-21swapper/121:06:371
24400991818,0cyclictest0-21swapper/120:10:021
24400991818,0cyclictest0-21swapper/119:46:391
24396991818,0cyclictest0-21swapper/020:46:370
24396991818,0cyclictest0-21swapper/020:01:380
24396991817,1cyclictest11593-21apt-get19:51:390
24408991716,0cyclictest0-21swapper/319:16:383
24408991715,1cyclictest18419-21dump-pmu-power20:05:003
24405991715,1cyclictest6431-21perf19:40:012
24405991710,6cyclictest28-21ksoftirqd/221:01:372
24396991717,0cyclictest0-21swapper/020:06:380
2439699171,11cyclictest19556-21munin-node20:30:400
2439699170,16cyclictest27134-21apt-get19:16:380
24408991614,1cyclictest15998-21systemctl20:00:003
2440899160,0cyclictest0-21swapper/320:21:133
24405991616,0cyclictest0-21swapper/220:31:382
24405991614,1cyclictest27316-21memory20:21:422
24405991614,1cyclictest0-21swapper/219:26:382
24400991616,0cyclictest0-21swapper/120:51:381
2440099160,2cyclictest3288-21perf20:40:011
24396991615,0cyclictest0-21swapper/020:21:380
24408991515,0cyclictest0-21swapper/320:46:373
24408991514,1cyclictest3292-21idleruntime-cro20:40:013
24408991514,1cyclictest0-21swapper/319:35:053
24408991513,1cyclictest6773-21/usr/sbin/munin19:41:453
24405991515,0cyclictest0-21swapper/219:31:372
2440099150,12cyclictest611-21irqbalance20:28:001
2440099150,12cyclictest611-21irqbalance20:28:001
24396991515,0cyclictest0-21swapper/020:26:390
24396991515,0cyclictest0-21swapper/020:26:390
2439699150,14cyclictest0-21swapper/021:01:400
2440899140,14cyclictest0-21swapper/321:00:043
2440899140,0cyclictest0-21swapper/319:11:053
24405991414,0cyclictest0-21swapper/220:53:242
2440599140,14cyclictest0-21swapper/220:46:012
2440599140,0cyclictest0-21swapper/219:40:372
2440099140,14cyclictest0-21swapper/121:00:321
2440099140,14cyclictest0-21swapper/119:11:501
24396991414,0cyclictest0-21swapper/020:15:150
24396991414,0cyclictest0-21swapper/019:45:360
24396991414,0cyclictest0-21swapper/019:26:540
2439699140,14cyclictest0-21swapper/020:40:090
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional