You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-08 - 17:15

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Wed Jul 08, 2026 12:44:24)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
12530992719,7cyclictest16474-21latency_hist10:45:001
1253099270,26cyclictest17609-21munin-run11:15:011
1253099270,26cyclictest0-21swapper/109:21:391
1253099270,20cyclictest8479-21sensors_temp12:31:481
12530992623,3cyclictest0-21swapper/109:46:191
12530992621,4cyclictest6230-21diskmemload10:53:591
12530992620,5cyclictest6230-21diskmemload10:29:441
1253099260,1cyclictest6230-21diskmemload11:26:371
1253099260,1cyclictest23950-21ssh11:20:441
1253099260,1cyclictest0-21swapper/110:14:081
12528992624,1cyclictest21650irq/140-nvme0q107:20:010
1252899260,25cyclictest0-21swapper/012:26:310
1253899250,24cyclictest27418-21awk07:40:003
1253499250,24cyclictest6230-21diskmemload12:26:442
1253499250,23cyclictest0-21swapper/209:11:012
12530992520,5cyclictest28147-21ssh12:21:401
12530992520,4cyclictest6230-21diskmemload11:00:131
12530992520,4cyclictest11431-21ssh09:42:201
12530992511,2cyclictest7520-21ssh11:06:121
1253099250,24cyclictest6230-21diskmemload11:46:411
1253099250,24cyclictest0-21swapper/112:00:371
1253099250,20cyclictest26392-21apt-get11:51:391
1253099250,1cyclictest10330-21ssh10:39:201
1253099250,0cyclictest6230-21diskmemload09:34:221
1252899250,24cyclictest0-21swapper/012:15:500
1253899242,21cyclictest23148-21sh09:24:553
12538992422,1cyclictest0-21swapper/309:19:383
1253899240,23cyclictest6230-21diskmemload09:11:553
1253899240,23cyclictest0-21swapper/311:54:573
1253899240,23cyclictest0-21swapper/311:40:423
1253899240,23cyclictest0-21swapper/311:34:303
1253899240,23cyclictest0-21swapper/311:05:153
12534992422,1cyclictest23993-21ssh09:53:572
12534992422,1cyclictest19467-21awk08:30:002
1253499240,24cyclictest0-21swapper/209:20:082
1253499240,23cyclictest0-21swapper/212:01:052
1253499240,0cyclictest0-21swapper/212:10:152
12530992421,3cyclictest0-21swapper/110:16:181
12530992421,2cyclictest0-21swapper/110:20:091
12530992421,2cyclictest0-21swapper/110:20:091
12530992420,4cyclictest6230-21diskmemload12:08:101
12530992420,4cyclictest0-21swapper/110:55:541
12530992420,3cyclictest0-21swapper/110:31:261
12530992419,4cyclictest6230-21diskmemload10:07:471
12530992419,4cyclictest0-21swapper/112:36:411
1253099240,24cyclictest0-21swapper/110:00:091
1253099240,24cyclictest0-21swapper/109:10:301
1253099240,23cyclictest6230-21diskmemload11:41:421
1253099240,23cyclictest29164-21ssh09:58:241
1253099240,23cyclictest0-21swapper/109:39:531
1253099240,23cyclictest0-21swapper/109:39:531
1253099240,0cyclictest0-21swapper/112:16:031
1253099240,0cyclictest0-21swapper/110:45:041
1253099240,0cyclictest0-21swapper/109:27:541
1253099240,0cyclictest0-21swapper/109:16:341
12528992424,0cyclictest0-21swapper/010:15:190
12528992424,0cyclictest0-21swapper/009:34:520
12528992423,1cyclictest0-21swapper/010:38:150
12528992422,2cyclictest17642-21kworker/u8:210:14:440
12528992422,1cyclictest1162-21sh11:28:580
12528992421,2cyclictest10965-21rm12:34:500
1252899240,2cyclictest8284-21sh11:35:330
1252899240,23cyclictest6414-21turbostat11:05:000
1252899240,23cyclictest3010-21sh09:35:590
1252899240,23cyclictest3010-21sh09:35:590
1252899240,23cyclictest26751-21sh10:53:550
1252899240,23cyclictest0-21swapper/011:44:480
1252899240,23cyclictest0-21swapper/010:31:110
1252899240,23cyclictest0-21swapper/009:55:320
1252899240,0cyclictest0-21swapper/012:06:340
1252899240,0cyclictest0-21swapper/009:18:390
12538992323,0cyclictest0-21swapper/311:58:293
12538992323,0cyclictest0-21swapper/310:58:393
12538992323,0cyclictest0-21swapper/310:43:053
12538992323,0cyclictest0-21swapper/310:04:563
12538992322,1cyclictest27255-21ssh12:20:263
12538992321,1cyclictest6230-21diskmemload12:01:163
12538992321,1cyclictest17969-21ssh10:46:383
12538992321,1cyclictest15044-21apt-get08:21:393
12538992321,1cyclictest14991-21ssh12:37:403
12538992321,1cyclictest10052-21sh12:33:303
12538992321,1cyclictest0-21swapper/311:27:133
12538992321,1cyclictest0-21swapper/311:20:453
12538992321,1cyclictest0-21swapper/311:12:073
12538992321,1cyclictest0-21swapper/311:02:113
12538992321,1cyclictest0-21swapper/310:19:313
1253899230,2cyclictest24265-21ssh09:25:593
1253899230,23cyclictest0-21swapper/310:12:403
1253899230,22cyclictest6230-21diskmemload12:07:233
1253899230,22cyclictest6230-21diskmemload11:15:383
1253899230,22cyclictest4569-21sh10:34:093
1253899230,22cyclictest24576-21ssh12:17:093
1253899230,22cyclictest17374-21ssh09:47:453
1253899230,22cyclictest12808-21ssh11:39:193
1253899230,22cyclictest0-21swapper/309:51:363
1253899230,0cyclictest6230-21diskmemload12:25:543
1253899230,0cyclictest0-21swapper/312:13:373
1253899230,0cyclictest0-21swapper/311:46:153
1253899230,0cyclictest0-21swapper/310:50:463
12534992323,0cyclictest6230-21diskmemload12:15:592
12534992323,0cyclictest6230-21diskmemload10:07:012
12534992323,0cyclictest0-21swapper/212:23:252
12534992323,0cyclictest0-21swapper/210:30:132
12534992323,0cyclictest0-21swapper/210:10:212
12534992321,1cyclictest25559-21rm11:50:312
12534992321,1cyclictest0-21swapper/211:55:082
12534992320,2cyclictest8287-21sh09:40:282
12534992320,2cyclictest11753-21ssh11:09:402
12534992319,4cyclictest0-21swapper/211:12:062
1253499230,2cyclictest21540-21ssh11:17:392
1253499230,22cyclictest6230-21diskmemload10:01:212
1253499230,22cyclictest26101-21apt-key10:25:012
1253499230,22cyclictest26101-21apt-key10:25:012
1253499230,22cyclictest16621-21users09:46:492
1253499230,22cyclictest10620-21ssh12:06:172
1253499230,22cyclictest0-21swapper/209:31:402
1253499230,1cyclictest0-21swapper/210:51:572
12530992323,0cyclictest0-21swapper/111:55:441
12530992320,3cyclictest0-21swapper/112:28:291
1253099230,23cyclictest0-21swapper/111:18:411
1253099230,23cyclictest0-21swapper/109:50:161
1253099230,22cyclictest6230-21diskmemload11:35:021
12528992323,0cyclictest6230-21diskmemload11:59:450
12528992323,0cyclictest0-21swapper/011:21:220
12528992323,0cyclictest0-21swapper/009:10:040
12528992321,1cyclictest0-21swapper/011:05:410
12528992320,2cyclictest16236-21rm11:13:030
1252899231,21cyclictest62550irq/127-eno112:20:050
1252899230,23cyclictest0-21swapper/010:27:500
1252899230,22cyclictest6230-21diskmemload09:46:530
1252899230,22cyclictest18128-21sh09:20:150
1252899230,22cyclictest17963-21/usr/sbin/munin10:46:380
1252899230,22cyclictest17851-21ssh11:15:030
1252899230,22cyclictest0-21swapper/010:20:310
1252899230,22cyclictest0-21swapper/010:20:310
1252899230,21cyclictest0-21swapper/010:01:030
1252899230,0cyclictest146712sleep010:42:270
1252899230,0cyclictest0-21swapper/009:42:520
12538992221,1cyclictest6230-21diskmemload10:23:353
12538992221,1cyclictest6230-21diskmemload10:23:353
12538992220,1cyclictest0-21swapper/309:55:183
1253899220,22cyclictest0-21swapper/310:36:153
1253899220,21cyclictest30770-21ssh10:28:183
1253899220,21cyclictest0-21swapper/310:05:433
1253899220,21cyclictest0-21swapper/309:31:453
1253899220,1cyclictest32210-21cat07:50:003
1253899220,1cyclictest22231-21apt-get08:36:393
1253899220,1cyclictest0-21swapper/309:40:543
1253899220,0cyclictest0-21swapper/309:35:393
1253899220,0cyclictest0-21swapper/309:35:393
12534992222,0cyclictest0-21swapper/211:01:462
12534992222,0cyclictest0-21swapper/210:40:562
12534992222,0cyclictest0-21swapper/209:58:012
12534992221,1cyclictest6545-21kworker/u8:009:25:592
12534992220,1cyclictest28343-21ssh10:55:442
12534992220,1cyclictest0-21swapper/210:15:212
12534992218,3cyclictest23459-21sh11:20:082
1253499220,21cyclictest7344-21hddtemp_smartct10:36:402
1253499220,21cyclictest6230-21diskmemload12:30:092
1253499220,21cyclictest6230-21diskmemload11:26:332
1253499220,21cyclictest28094-21cstates10:26:412
1253499220,21cyclictest0-21swapper/211:31:152
1253499220,21cyclictest0-21swapper/210:45:222
1253499220,21cyclictest0-21swapper/209:35:282
1253499220,21cyclictest0-21swapper/209:35:282
1253499220,21cyclictest0-21swapper/208:21:392
1253499220,1cyclictest19322-21ssh11:45:152
1253499220,0cyclictest0-21swapper/209:18:082
12530992220,1cyclictest6239-21apt09:10:001
12530992220,1cyclictest0-21swapper/108:50:011
1253099220,21cyclictest0-21swapper/108:35:001
1253099220,21cyclictest0-21swapper/108:30:001
1253099220,21cyclictest0-21swapper/107:21:391
12528992222,0cyclictest0-21swapper/012:35:270
12528992220,1cyclictest22502-21perf07:30:010
12528992220,1cyclictest0-21swapper/010:56:410
1252899220,22cyclictest0-21swapper/012:10:220
1252899220,21cyclictest32582-21apt-get07:51:390
1252899220,21cyclictest14225-21sendmail08:20:010
1252899220,21cyclictest0-21swapper/012:00:300
1252899220,21cyclictest0-21swapper/011:50:030
1252899220,21cyclictest0-21swapper/010:05:090
1252899220,21cyclictest0-21swapper/009:01:400
1252899220,21cyclictest0-21swapper/007:31:390
1252899220,1cyclictest62550irq/127-eno109:52:400
1252899220,0cyclictest0-21swapper/011:48:330
1252899220,0cyclictest0-21swapper/011:34:120
12538992120,0cyclictest15268-21apt-get07:16:403
1253899210,20cyclictest0-21swapper/308:16:393
1253899210,20cyclictest0-21swapper/307:31:393
1253899210,0cyclictest0-21swapper/308:26:383
12534992121,0cyclictest0-21swapper/207:36:392
12534992121,0cyclictest0-21swapper/207:21:392
12534992119,1cyclictest606-21dbus-daemon07:50:002
12534992119,1cyclictest0-21swapper/207:20:012
1253499210,21cyclictest0-21swapper/208:16:392
1253499210,21cyclictest0-21swapper/207:31:392
1253499210,1cyclictest8335-21ssh11:35:362
1253499210,1cyclictest7069-21munin-run08:05:012
1253499210,0cyclictest0-21swapper/208:51:402
12530992121,0cyclictest0-21swapper/108:01:381
12530992120,1cyclictest0-21swapper/108:20:021
1253099210,20cyclictest0-21swapper/108:36:391
1253099210,1cyclictest1840-21apt-get09:01:401
12528992121,0cyclictest0-21swapper/008:51:400
1252899210,0cyclictest0-21swapper/009:25:310
12538992020,0cyclictest0-21swapper/308:51:403
12538992020,0cyclictest0-21swapper/307:11:393
12538992020,0cyclictest0-21swapper/307:11:393
12534992020,0cyclictest0-21swapper/208:31:372
12534992020,0cyclictest0-21swapper/207:26:402
12534992018,1cyclictest1398-21cron09:00:012
12530992020,0cyclictest0-21swapper/107:16:401
12530992019,1cyclictest1446-21latency_hist09:00:011
1253099200,19cyclictest0-21swapper/108:16:481
1253099200,0cyclictest0-21swapper/107:56:491
12528992020,0cyclictest0-21swapper/007:41:400
12528992020,0cyclictest0-21swapper/007:36:390
12528992019,0cyclictest0-21swapper/007:21:390
1252899200,0cyclictest0-21swapper/008:41:390
12538991919,0cyclictest0-21swapper/308:11:403
12538991919,0cyclictest0-21swapper/308:06:393
12538991918,1cyclictest4233-21apt-get09:06:393
12534991919,0cyclictest32582-21apt-get07:51:392
12534991919,0cyclictest0-21swapper/208:46:402
12534991918,0cyclictest0-21swapper/207:56:402
12530991919,0cyclictest0-21swapper/107:36:391
12530991918,1cyclictest2196-21grep07:55:001
12530991917,1cyclictest9829-21apt-get08:11:401
12530991914,5cyclictest27791-21apt-get07:41:401
12528991919,0cyclictest0-21swapper/008:31:370
12528991917,1cyclictest0-21swapper/009:06:390
1252899190,1cyclictest0-21swapper/007:11:430
1252899190,1cyclictest0-21swapper/007:11:430
12538991818,0cyclictest0-21swapper/308:01:383
12538991818,0cyclictest0-21swapper/307:51:393
12534991818,0cyclictest0-21swapper/209:01:402
12534991818,0cyclictest0-21swapper/207:40:482
12530991818,0cyclictest0-21swapper/108:41:391
12530991816,1cyclictest22873-21apt-get07:31:401
1253099180,1cyclictest22497-21munin-run07:30:011
12528991818,0cyclictest0-21swapper/008:56:400
12538991717,0cyclictest31834-21apt-get08:56:403
12538991717,0cyclictest0-21swapper/308:46:403
12534991717,0cyclictest7435-21apt-get08:06:392
12528991716,0cyclictest0-21swapper/008:11:400
12534991616,0cyclictest0-21swapper/209:06:392
12534991614,1cyclictest0-21swapper/208:11:402
1253499160,2cyclictest14574-21grep07:11:492
1253499160,2cyclictest14574-21grep07:11:492
12530991615,0cyclictest30192-21apt-get07:46:401
12528991616,0cyclictest0-21swapper/008:46:400
12528991616,0cyclictest0-21swapper/008:36:390
12538991515,0cyclictest24647-21apt-get08:41:393
12538991515,0cyclictest18082-21apt-get07:21:393
12538991513,1cyclictest0-21swapper/307:26:423
1253899150,14cyclictest19830-21apt-get08:31:373
12528991515,0cyclictest7435-21apt-get08:06:390
12538991414,0cyclictest0-21swapper/307:56:013
12538991414,0cyclictest0-21swapper/307:41:403
1253899140,14cyclictest0-21swapper/309:00:173
1253499140,14cyclictest0-21swapper/208:40:192
1253499140,0cyclictest0-21swapper/208:35:362
12530991414,0cyclictest0-21swapper/108:52:121
12530991412,0cyclictest0-21swapper/107:10:381
12530991412,0cyclictest0-21swapper/107:10:381
1253099140,14cyclictest0-21swapper/108:05:281
12528991414,0cyclictest0-21swapper/008:26:110
12528991414,0cyclictest0-21swapper/008:21:180
12528991414,0cyclictest0-21swapper/007:56:410
12528991414,0cyclictest0-21swapper/007:45:100
1252899140,14cyclictest0-21swapper/008:00:330
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional