You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-17 - 05:38

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Fri Jul 17, 2026 00:44:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1838399300,29cyclictest0-21swapper/322:47:053
1838399270,0cyclictest0-21swapper/323:27:233
18383992623,3cyclictest0-21swapper/321:16:283
1838399260,25cyclictest0-21swapper/300:07:423
1838399260,1cyclictest0-21swapper/323:56:473
18383992523,2cyclictest0-21swapper/322:33:383
18383992521,3cyclictest0-21swapper/322:12:223
18383992520,4cyclictest0-21swapper/300:30:433
1838399250,5cyclictest13550-21apt-get23:07:223
1838399250,2cyclictest11668-21diskmemload22:06:023
1838399250,24cyclictest0-21swapper/321:44:423
1838399250,21cyclictest0-21swapper/321:27:153
1838399250,1cyclictest24000-21ssh22:18:093
1838399250,1cyclictest23922-21ssh23:44:413
1838399250,1cyclictest0-21swapper/323:31:103
1838399250,0cyclictest11668-21diskmemload22:02:473
1838399250,0cyclictest0-21swapper/323:50:393
1838399250,0cyclictest0-21swapper/322:35:223
1838399250,0cyclictest0-21swapper/300:21:143
1838399250,0cyclictest0-21swapper/300:17:223
1838099250,24cyclictest0-21swapper/223:21:182
18378992523,1cyclictest0-21swapper/122:14:051
1837899250,24cyclictest11668-21diskmemload23:17:291
1837899250,24cyclictest11668-21diskmemload22:37:381
1837899250,24cyclictest11668-21diskmemload21:13:551
1837899250,24cyclictest0-21swapper/122:01:431
1837899250,1cyclictest18828-21sh23:12:101
1837899250,1cyclictest0-21swapper/123:22:211
18373992522,2cyclictest0-21swapper/023:09:540
1837399250,1cyclictest18432-21ssh00:07:420
1838399242,1cyclictest9139-21sh21:37:073
18383992421,3cyclictest7378-21kworker/u8:200:00:073
18383992420,3cyclictest24882-21apt-get20:32:223
18383992420,3cyclictest0-21swapper/321:47:223
18383992418,5cyclictest24890-21sh00:13:533
1838399240,23cyclictest11668-21diskmemload23:47:033
1838399240,23cyclictest0-21swapper/323:16:043
1838399240,23cyclictest0-21swapper/322:56:323
1838399240,23cyclictest0-21swapper/321:11:443
1838399240,20cyclictest11668-21diskmemload21:55:023
1838399240,1cyclictest0-21swapper/321:24:173
1838399240,0cyclictest0-21swapper/323:36:533
1838399240,0cyclictest0-21swapper/321:30:403
18380992423,0cyclictest0-21swapper/221:53:282
18380992422,1cyclictest3067-21cron22:00:002
1838099240,23cyclictest21547-21kernelversion21:47:272
1838099240,23cyclictest11668-21diskmemload23:27:242
1838099240,23cyclictest0-21swapper/221:36:002
1838099240,0cyclictest11668-21diskmemload22:33:552
1838099240,0cyclictest0-21swapper/222:49:162
1838099240,0cyclictest0-21swapper/221:43:262
18378992424,0cyclictest0-21swapper/121:27:491
18378992424,0cyclictest0-21swapper/100:10:001
18378992423,1cyclictest30921-21ssh23:50:461
18378992422,2cyclictest13836-21ssh23:36:011
18378992422,1cyclictest24712-21ssh22:19:121
18378992422,1cyclictest0-21swapper/100:40:011
18378992421,2cyclictest11668-21diskmemload22:22:311
1837899240,24cyclictest0-21swapper/123:25:381
1837899240,23cyclictest5205-21ssh00:25:401
18373992423,1cyclictest62550irq/127-eno123:45:010
18373992422,1cyclictest9700-21cron22:35:000
1837399240,23cyclictest0-21swapper/021:26:140
1837399240,0cyclictest0-21swapper/022:06:030
1837399240,0cyclictest0-21swapper/021:10:240
18383992321,1cyclictest0-21swapper/322:41:353
18383992320,2cyclictest31656-21sh22:25:423
18383992319,3cyclictest11668-21diskmemload23:04:173
18383992318,4cyclictest0-21swapper/322:23:263
18383992317,5cyclictest29277-21idleruntime-cro20:40:013
1838399230,22cyclictest5543-21ssh00:26:053
1838399230,0cyclictest0-21swapper/300:36:413
18380992323,0cyclictest11668-21diskmemload23:42:472
18380992323,0cyclictest0-21swapper/222:12:202
18380992323,0cyclictest0-21swapper/222:02:452
18380992323,0cyclictest0-21swapper/200:23:182
18380992323,0cyclictest0-21swapper/200:14:142
18380992322,1cyclictest11668-21diskmemload22:53:232
18380992321,1cyclictest0-21swapper/222:43:042
18380992321,1cyclictest0-21swapper/221:11:182
1838099230,23cyclictest0-21swapper/223:50:392
1838099230,23cyclictest0-21swapper/200:36:062
1838099230,22cyclictest31895-21kworker/u8:022:26:172
1838099230,22cyclictest15391-21awk22:40:002
1838099230,22cyclictest11668-21diskmemload00:17:072
1838099230,22cyclictest11668-21diskmemload00:02:462
1838099230,22cyclictest0-21swapper/223:37:552
1838099230,22cyclictest0-21swapper/222:20:272
1838099230,1cyclictest0-21swapper/223:33:192
1838099230,18cyclictest29265-21perf20:40:012
1838099230,0cyclictest11668-21diskmemload21:32:182
1838099230,0cyclictest0-21swapper/223:55:142
1838099230,0cyclictest0-21swapper/223:46:052
18378992323,0cyclictest11668-21diskmemload21:50:211
18378992323,0cyclictest0-21swapper/122:53:241
18378992323,0cyclictest0-21swapper/121:21:411
18378992323,0cyclictest0-21swapper/100:21:501
18378992321,1cyclictest0-21swapper/123:46:521
18378992321,1cyclictest0-21swapper/120:05:011
18378992321,1cyclictest0-21swapper/119:45:001
18378992320,2cyclictest6347-21expr22:32:221
1837899230,2cyclictest19638-21latency_hist20:20:001
1837899230,2cyclictest14826-21awk20:10:001
1837899230,22cyclictest9602-21sh22:06:051
1837899230,22cyclictest9294-21latency_hist21:05:001
1837899230,22cyclictest30299-21sh21:55:201
1837899230,22cyclictest21561-21kernelversion21:47:271
1837899230,22cyclictest14005-21sh21:40:581
1837899230,22cyclictest11668-21diskmemload22:40:361
1837899230,22cyclictest1133-21sh22:56:221
1837899230,0cyclictest0-21swapper/123:43:521
1837899230,0cyclictest0-21swapper/123:30:201
1837899230,0cyclictest0-21swapper/123:08:481
1837899230,0cyclictest0-21swapper/121:17:521
1837899230,0cyclictest0-21swapper/100:13:311
18373992323,0cyclictest0-21swapper/023:58:010
18373992323,0cyclictest0-21swapper/022:22:030
1837399230,2cyclictest15907-21ssh22:40:240
1837399230,2cyclictest12452-21idleruntime-cro20:05:010
1837399230,23cyclictest11625-21ssh21:38:020
1837399230,23cyclictest0-21swapper/021:47:300
1837399230,23cyclictest0-21swapper/000:16:120
1837399230,22cyclictest745-21rm23:24:090
1837399230,22cyclictest27296-21ssh22:50:030
1837399230,22cyclictest11668-21diskmemload00:20:200
1837399230,22cyclictest0-21swapper/021:32:500
1837399230,1cyclictest7906-21sh23:30:250
1837399230,0cyclictest11668-21diskmemload21:15:410
1837399230,0cyclictest0-21swapper/022:37:220
1837399230,0cyclictest0-21swapper/021:44:130
1837399230,0cyclictest0-21swapper/000:12:030
1837399230,0cyclictest0-21swapper/000:01:360
1838399220,22cyclictest11668-21diskmemload23:11:133
1838399220,21cyclictest2091-21latency_hist20:50:013
1838399220,21cyclictest0-21swapper/320:22:223
1838399220,1cyclictest0-21swapper/320:40:023
1838399220,1cyclictest0-21swapper/319:32:203
1838399220,0cyclictest0-21swapper/323:22:203
18380992222,0cyclictest0-21swapper/223:11:222
18380992221,1cyclictest0-21swapper/221:25:332
18380992220,1cyclictest24449-21perf20:30:002
18380992220,1cyclictest0-21swapper/223:06:312
18380992220,1cyclictest0-21swapper/223:00:522
1838099220,22cyclictest0-21swapper/222:08:252
1838099220,21cyclictest11668-21diskmemload00:05:362
1838099220,21cyclictest0-21swapper/222:55:322
1838099220,21cyclictest0-21swapper/222:16:042
1838099220,21cyclictest0-21swapper/220:42:212
1838099220,21cyclictest0-21swapper/220:12:212
1838099220,1cyclictest11668-21diskmemload00:27:532
1838099220,1cyclictest0-21swapper/221:22:232
1838099220,1cyclictest0-21swapper/221:16:272
18378992222,0cyclictest0-21swapper/122:47:271
18378992222,0cyclictest0-21swapper/100:30:191
18378992221,1cyclictest9764-21sh00:00:391
18378992220,1cyclictest6281-21apt-get23:00:021
18378992220,1cyclictest4160-21sh23:55:451
18378992220,1cyclictest28743-21ntp_states00:17:291
1837899220,22cyclictest0-21swapper/120:57:211
1837899220,21cyclictest0-21swapper/121:30:151
1837899220,1cyclictest385-21apt-get22:27:221
1837899220,1cyclictest0-21swapper/121:36:311
18373992222,0cyclictest0-21swapper/023:36:530
18373992222,0cyclictest0-21swapper/022:45:500
18373992222,0cyclictest0-21swapper/022:15:420
18373992222,0cyclictest0-21swapper/021:55:380
18373992222,0cyclictest0-21swapper/000:37:040
18373992222,0cyclictest0-21swapper/000:31:410
18373992219,2cyclictest7197-21rm23:01:200
1837399220,22cyclictest7168-21sh22:02:580
1837399220,22cyclictest0-21swapper/023:40:030
1837399220,22cyclictest0-21swapper/023:11:260
1837399220,21cyclictest24166-21ssh21:21:100
1837399220,21cyclictest23227-21diskmemload23:15:320
1837399220,21cyclictest21168-21apt-get19:17:220
1837399220,21cyclictest1744-21ssh23:25:090
1837399220,21cyclictest17236-21apt20:15:000
1837399220,21cyclictest0-21swapper/021:00:000
1837399220,1cyclictest31290-21ssh23:51:140
1837399220,1cyclictest30350-21munin-run19:35:000
1837399220,1cyclictest2819-21sh22:28:080
1837399220,1cyclictest11668-21diskmemload22:56:070
18383992120,1cyclictest0-21swapper/320:30:003
18380992120,1cyclictest0-21swapper/220:07:222
18380992119,1cyclictest0-21swapper/219:40:002
18380992119,1cyclictest0-21swapper/200:31:442
1838099210,20cyclictest0-21swapper/219:22:192
1838099210,0cyclictest0-21swapper/223:15:482
18378992121,0cyclictest0-21swapper/120:47:221
18378992118,2cyclictest22-21ksoftirqd/120:00:011
1837899210,0cyclictest0-21swapper/119:52:211
18373992119,1cyclictest313-21systemd-journal20:20:000
1837399210,21cyclictest62550irq/127-eno119:27:200
1837399210,21cyclictest0-21swapper/000:25:060
1837399210,0cyclictest0-21swapper/020:47:210
18383992020,0cyclictest0-21swapper/321:02:213
18383992020,0cyclictest0-21swapper/319:17:213
1838399200,20cyclictest0-21swapper/319:52:213
1838399200,19cyclictest0-21swapper/319:47:233
1838399200,19cyclictest0-21swapper/319:47:233
1838399200,0cyclictest30770-21apt-get19:37:203
1838399200,0cyclictest0-21swapper/320:12:213
1838399200,0cyclictest0-21swapper/319:12:213
18380992020,0cyclictest0-21swapper/220:47:222
18380992019,0cyclictest0-21swapper/220:02:212
18380992017,2cyclictest23106-21sendmail19:20:002
1838099200,0cyclictest2523-21apt-get20:52:212
1838099200,0cyclictest0-21swapper/221:07:222
1837899200,20cyclictest0-21swapper/119:12:211
18373992020,0cyclictest29264-21dpkg20:40:010
18373992020,0cyclictest0-21swapper/020:07:210
18373992020,0cyclictest0-21swapper/019:37:200
18373992019,1cyclictest9731-21apt-get21:07:220
18373992018,1cyclictest29880-21apt-get20:40:020
18383991917,1cyclictest4478-21perf20:55:003
1838399190,1cyclictest9698-21/usr/sbin/munin21:07:233
1838399190,18cyclictest6615-21sed20:57:313
18380991919,0cyclictest753-21apt-get19:42:212
18380991919,0cyclictest0-21swapper/220:32:222
18380991919,0cyclictest0-21swapper/219:30:002
18378991917,1cyclictest30770-21apt-get19:37:201
18373991919,0cyclictest0-21swapper/020:52:210
18373991918,1cyclictest0-21swapper/019:47:310
18373991918,1cyclictest0-21swapper/019:47:310
18373991917,1cyclictest24444-21turbostat20:30:000
1837399190,0cyclictest23582-21apt-get19:22:190
18383991818,0cyclictest0-21swapper/319:42:213
18383991817,1cyclictest10481-21apt-get20:02:213
18380991817,1cyclictest0-21swapper/219:57:202
18378991818,0cyclictest0-21swapper/119:47:231
18378991818,0cyclictest0-21swapper/119:47:231
18378991817,0cyclictest28377-21apt-get19:32:201
18373991817,1cyclictest18771-21apt-get19:12:210
1838399170,1cyclictest0-21swapper/320:07:323
18380991717,0cyclictest0-21swapper/219:32:202
18380991716,1cyclictest3227-21apt-get19:47:232
18380991716,1cyclictest3227-21apt-get19:47:232
18378991717,0cyclictest0-21swapper/120:32:221
18378991717,0cyclictest0-21swapper/119:27:411
18378991717,0cyclictest0-21swapper/119:22:191
18378991716,1cyclictest0-21swapper/119:17:221
18378991715,1cyclictest606-21dbus-daemon20:15:001
18383991616,0cyclictest0-21swapper/319:57:203
1838399160,15cyclictest0-21swapper/320:17:253
18380991616,0cyclictest0-21swapper/219:52:212
18380991616,0cyclictest0-21swapper/219:12:212
18380991614,1cyclictest7951-21sed21:02:232
18380991614,1cyclictest0-21swapper/221:00:002
18373991615,1cyclictest0-21swapper/020:32:220
18373991613,2cyclictest1174-21expr19:42:220
1837399160,15cyclictest9313-21perf21:05:000
18383991515,0cyclictest0-21swapper/319:22:193
1838399150,14cyclictest0-21swapper/319:27:243
18380991514,1cyclictest20091-21apt-get20:22:212
18378991515,0cyclictest0-21swapper/120:37:211
1837899150,15cyclictest0-21swapper/120:52:261
18373991513,1cyclictest7389-21users19:52:310
18378991414,0cyclictest0-21swapper/121:07:081
18378991413,1cyclictest29249-21apt-get20:40:021
1837899140,0cyclictest0-21swapper/120:20:211
18373991414,0cyclictest0-21swapper/020:20:510
1837399140,0cyclictest0-21swapper/019:55:210
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional