You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-12 - 06:04

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Wed Aug 12, 2026 00:44:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1569099260,25cyclictest29338-21basename20:45:013
1569099250,24cyclictest0-21swapper/322:12:083
1569099250,1cyclictest4515-21cron23:30:003
1569099250,1cyclictest12238-21ssh23:09:013
1568499251,23cyclictest4173-21timerwakeupswit23:29:402
1568499250,24cyclictest2323-21sh23:56:472
1568199250,24cyclictest923-21ssh23:27:211
1568199250,1cyclictest11356-21sh21:12:431
1567799250,24cyclictest8919-21diskmemload22:32:220
1567799250,1cyclictest0-21swapper/000:02:590
1569099240,23cyclictest8919-21diskmemload00:37:333
1569099240,23cyclictest0-21swapper/323:43:033
1569099240,23cyclictest0-21swapper/323:01:483
1569099240,23cyclictest0-21swapper/321:22:123
15684992423,1cyclictest0-21swapper/223:43:222
15684992423,0cyclictest0-21swapper/200:24:482
1568499240,2cyclictest313-21systemd-journal19:35:002
1568499240,24cyclictest8919-21diskmemload22:34:452
1568499240,23cyclictest8919-21diskmemload23:23:452
1568499240,23cyclictest8919-21diskmemload21:55:202
1568499240,23cyclictest14483-21ssh00:35:282
15681992423,1cyclictest8919-21diskmemload23:04:481
1568199240,24cyclictest8919-21diskmemload23:18:431
1568199240,24cyclictest0-21swapper/123:35:381
1568199240,24cyclictest0-21swapper/121:23:491
1568199240,24cyclictest0-21swapper/100:11:281
1568199240,1cyclictest0-21swapper/122:54:191
1567799240,24cyclictest0-21swapper/021:23:000
1567799240,23cyclictest0-21swapper/023:22:530
1567799240,1cyclictest21527-21apt-get22:19:320
1567799240,0cyclictest8919-21diskmemload21:49:130
1567799240,0cyclictest8919-21diskmemload00:11:490
15690992323,0cyclictest0-21swapper/323:52:243
15690992323,0cyclictest0-21swapper/322:17:593
15690992323,0cyclictest0-21swapper/300:28:123
15690992322,1cyclictest0-21swapper/321:16:523
15690992321,1cyclictest29371-21munin-run22:25:013
15690992321,1cyclictest0-21swapper/323:34:513
15690992321,1cyclictest0-21swapper/322:39:323
15690992321,1cyclictest0-21swapper/322:02:533
15690992321,1cyclictest0-21swapper/321:32:503
15690992320,2cyclictest24983-21ssh21:53:283
1569099230,2cyclictest8708-21ssh00:02:393
1569099230,2cyclictest31921-21basename21:30:013
1569099230,23cyclictest0-21swapper/321:41:213
1569099230,23cyclictest0-21swapper/321:10:293
1569099230,22cyclictest25392-21sh22:50:293
1569099230,22cyclictest23890-21ssh23:47:153
1569099230,22cyclictest20348-21grep23:15:013
1569099230,22cyclictest18482-21ssh00:10:113
1569099230,22cyclictest0-21swapper/300:21:143
1569099230,0cyclictest0-21swapper/323:15:023
1569099230,0cyclictest0-21swapper/322:27:423
1569099230,0cyclictest0-21swapper/321:55:073
1569099230,0cyclictest0-21swapper/300:31:233
15684992323,0cyclictest0-21swapper/222:14:112
15684992323,0cyclictest0-21swapper/200:14:102
15684992322,1cyclictest14511-21sh22:40:512
15684992322,0cyclictest0-21swapper/220:49:312
15684992321,1cyclictest30091-21sh19:40:002
15684992321,1cyclictest22812-21ssh22:49:302
15684992320,2cyclictest8919-21diskmemload21:47:422
15684992319,3cyclictest0-21swapper/221:30:072
1568499230,2cyclictest5011-21ssh23:30:202
1568499230,2cyclictest11243-21ssh21:12:342
1568499230,23cyclictest8919-21diskmemload22:16:422
1568499230,23cyclictest0-21swapper/223:07:172
1568499230,23cyclictest0-21swapper/223:01:002
1568499230,23cyclictest0-21swapper/200:34:172
1568499230,23cyclictest0-21swapper/200:26:312
1568499230,22cyclictest8919-21diskmemload23:51:052
1568499230,22cyclictest8578-21rm21:39:312
1568499230,22cyclictest27960-21ssh21:26:562
1568499230,22cyclictest21508-21ssh21:21:142
1568499230,22cyclictest20664-21sh23:15:092
1568499230,22cyclictest15462-21ssh21:15:352
1568499230,22cyclictest10442-21ssh22:09:292
1568499230,0cyclictest0-21swapper/221:44:112
15681992323,0cyclictest0-21swapper/123:20:391
15681992323,0cyclictest0-21swapper/122:40:411
15681992323,0cyclictest0-21swapper/121:59:551
15681992323,0cyclictest0-21swapper/100:31:581
15681992323,0cyclictest0-21swapper/100:28:191
15681992322,0cyclictest22749-21apt-get22:49:301
15681992321,1cyclictest14158-21ssh22:12:001
1568199231,22cyclictest6784-21ssh23:32:441
1568199231,1cyclictest32496-21dump-pmu-power19:45:001
1568199230,23cyclictest0-21swapper/121:38:551
1568199230,23cyclictest0-21swapper/100:17:071
1568199230,22cyclictest8919-21diskmemload23:06:451
1568199230,22cyclictest29957-21apt-get20:49:311
1568199230,22cyclictest13015-21ssh00:05:511
1568199230,22cyclictest0-21swapper/123:58:261
1568199230,0cyclictest8919-21diskmemload21:19:281
1568199230,0cyclictest16646-21ssh23:12:221
15677992323,0cyclictest0-21swapper/023:29:150
15677992323,0cyclictest0-21swapper/023:13:490
15677992323,0cyclictest0-21swapper/022:43:070
15677992323,0cyclictest0-21swapper/022:20:080
15677992323,0cyclictest0-21swapper/022:14:120
15677992323,0cyclictest0-21swapper/022:09:190
15677992323,0cyclictest0-21swapper/000:21:410
15677992322,1cyclictest0-21swapper/000:26:000
15677992321,1cyclictest31276-21sh21:59:280
15677992321,1cyclictest0-21swapper/023:15:070
1567799230,23cyclictest8919-21diskmemload00:38:380
1567799230,23cyclictest0-21swapper/023:08:280
1567799230,23cyclictest0-21swapper/022:02:550
1567799230,22cyclictest8919-21diskmemload00:30:540
1567799230,22cyclictest6468-40mandb00:00:010
1567799230,22cyclictest32759-21apt-get22:29:270
1567799230,22cyclictest31097-21ssh22:55:380
1567799230,22cyclictest19208-21ssh23:44:050
1567799230,22cyclictest0-21swapper/021:15:350
1567799230,0cyclictest8919-21diskmemload23:34:000
1567799230,0cyclictest0-21swapper/021:51:340
1567799230,0cyclictest0-21swapper/021:11:540
15690992222,0cyclictest0-21swapper/321:36:223
15690992221,1cyclictest0-21swapper/319:49:303
15690992221,1cyclictest0-21swapper/319:49:303
15690992219,2cyclictest774-21runrttasks22:43:513
1569099220,2cyclictest24540-21basename20:35:003
1569099220,21cyclictest8919-21diskmemload23:55:423
1569099220,21cyclictest6642-21apt-get22:05:023
1569099220,21cyclictest29354-21ssh23:24:293
1569099220,21cyclictest0-21swapper/323:37:023
1569099220,21cyclictest0-21swapper/322:46:233
1569099220,21cyclictest0-21swapper/322:32:503
1569099220,21cyclictest0-21swapper/300:20:013
1569099220,1cyclictest8919-21diskmemload00:05:533
1569099220,1cyclictest17673-21sh21:46:053
1569099220,0cyclictest8919-21diskmemload22:58:313
15684992222,0cyclictest0-21swapper/222:21:182
15684992220,1cyclictest0-21swapper/223:10:312
1568499221,1cyclictest15899-21ssh23:39:492
1568499220,22cyclictest24536-21ssh23:48:042
1568499220,22cyclictest0-21swapper/222:25:172
1568499220,21cyclictest32352-21ssh22:57:212
1568499220,21cyclictest30711-21apt-get19:44:302
1568499220,21cyclictest0-21swapper/222:50:082
1568499220,21cyclictest0-21swapper/220:00:012
1568499220,21cyclictest0-21swapper/200:05:032
1568499220,1cyclictest7152-21ssh00:00:312
1568499220,1cyclictest22915-21awk19:25:002
1568499220,1cyclictest13604-21latency_hist22:40:002
1568499220,1cyclictest0-21swapper/221:51:572
1568499220,0cyclictest0-21swapper/222:00:352
15681992222,0cyclictest0-21swapper/123:54:411
15681992222,0cyclictest0-21swapper/122:07:181
15681992222,0cyclictest0-21swapper/121:30:261
15681992222,0cyclictest0-21swapper/121:25:551
15681992221,1cyclictest8914-21cron21:10:001
15681992221,1cyclictest0-21swapper/122:37:451
15681992221,1cyclictest0-21swapper/122:22:471
1568199220,22cyclictest21585-21mailstats21:49:381
1568199220,22cyclictest20704-21ssh22:18:221
1568199220,22cyclictest0-21swapper/123:48:591
1568199220,22cyclictest0-21swapper/122:31:541
1568199220,21cyclictest8919-21diskmemload21:40:081
1568199220,21cyclictest7425-21sh00:00:521
1568199220,21cyclictest16564-21ssh23:40:191
1568199220,21cyclictest1-21systemd19:35:001
1568199220,21cyclictest0-21swapper/100:20:141
1568199220,1cyclictest23319-21taskset21:51:001
1568199220,1cyclictest1680-21ssh22:00:301
1568199220,0cyclictest0-21swapper/122:57:001
15677992222,0cyclictest8919-21diskmemload22:50:310
15677992222,0cyclictest0-21swapper/021:43:590
15677992222,0cyclictest0-21swapper/021:30:080
15677992222,0cyclictest0-21swapper/000:15:170
15677992220,1cyclictest20453-21awk19:20:000
15677992220,1cyclictest0-21swapper/020:25:020
1567799221,1cyclictest4514-21ssh23:01:020
1567799220,21cyclictest23510-21sh23:46:370
1567799220,21cyclictest2334-21apt-get20:59:310
1567799220,21cyclictest0-21swapper/023:35:160
1567799220,21cyclictest0-21swapper/021:36:020
1567799220,21cyclictest0-21swapper/021:09:320
1567799220,21cyclictest0-21swapper/020:14:320
1567799220,1cyclictest27499-21ssh21:26:120
1567799220,1cyclictest10072-21sh22:37:280
1567799220,1cyclictest0-21swapper/023:50:430
1567799220,1cyclictest0-21swapper/019:44:300
15690992121,0cyclictest0-21swapper/320:29:313
15690992121,0cyclictest0-21swapper/319:34:293
1569099210,20cyclictest0-21swapper/320:24:313
1569099210,1cyclictest0-21swapper/321:00:003
1569099210,0cyclictest0-21swapper/320:39:333
1569099210,0cyclictest0-21swapper/319:24:303
1568499210,21cyclictest0-21swapper/221:04:312
1568499210,21cyclictest0-21swapper/220:25:022
1568499210,20cyclictest0-21swapper/219:54:282
1568499210,20cyclictest0-21swapper/219:49:292
1568499210,20cyclictest0-21swapper/219:49:292
15681992121,0cyclictest665-21apt-get19:49:301
15681992121,0cyclictest665-21apt-get19:49:301
15681992121,0cyclictest0-21swapper/120:44:281
1568199210,21cyclictest0-21swapper/100:35:221
1568199210,20cyclictest12082-21turbostat20:10:001
1568199210,0cyclictest0-21swapper/119:39:301
1568199210,0cyclictest0-21swapper/119:29:301
15677992121,0cyclictest15087-21apt-get20:19:310
1567799210,0cyclictest10303-21apt-get20:09:380
1567799210,0cyclictest0-21swapper/022:46:310
1567799210,0cyclictest0-21swapper/019:24:300
1567799210,0cyclictest0-21swapper/019:14:290
15690992020,0cyclictest0-21swapper/321:09:323
15690992020,0cyclictest0-21swapper/319:39:303
15690992020,0cyclictest0-21swapper/319:19:303
15690992018,1cyclictest31762-21perf20:50:013
1569099200,0cyclictest0-21swapper/319:54:283
15684992020,0cyclictest0-21swapper/220:34:312
15684992019,1cyclictest0-21swapper/220:19:312
15684992019,0cyclictest0-21swapper/220:04:342
15681992020,0cyclictest0-21swapper/121:04:311
15681992020,0cyclictest0-21swapper/120:54:301
15681992020,0cyclictest0-21swapper/119:54:281
1568199200,20cyclictest0-21swapper/120:59:311
1568199200,0cyclictest7907-21apt-get20:04:331
15677992020,0cyclictest0-21swapper/020:49:310
15677992020,0cyclictest0-21swapper/020:39:330
15677992020,0cyclictest0-21swapper/019:34:300
15677992019,0cyclictest28294-21apt-get19:39:300
15677992018,1cyclictest25292-21perf19:30:000
15690991919,0cyclictest0-21swapper/319:44:303
15684991919,0cyclictest0-21swapper/220:54:312
15684991918,1cyclictest25149-21apt-get20:39:332
1568499190,18cyclictest0-21swapper/220:09:382
15681991919,0cyclictest20300-21apt-get20:29:311
15681991919,0cyclictest0-21swapper/120:19:311
15681991919,0cyclictest0-21swapper/120:14:311
15681991919,0cyclictest0-21swapper/119:24:311
15681991917,1cyclictest26926-21sh20:40:011
15677991917,1cyclictest2476-21latency_hist19:50:010
15677991917,1cyclictest2476-21latency_hist19:50:010
15690991818,0cyclictest0-21swapper/320:54:303
15684991818,0cyclictest0-21swapper/220:59:312
15684991817,1cyclictest8916-21sh21:10:002
15681991818,0cyclictest0-21swapper/120:34:311
15677991817,0cyclictest22753-21apt-get20:34:310
15677991816,1cyclictest9686-21sh20:05:010
15677991816,1cyclictest0-21swapper/019:55:010
15690991717,0cyclictest4752-21apt-get21:04:313
15690991715,2cyclictest7289-21apt20:00:013
15684991717,0cyclictest0-21swapper/220:14:322
1569099160,1cyclictest0-21swapper/320:09:383
15684991616,0cyclictest0-21swapper/220:44:282
15684991616,0cyclictest0-21swapper/220:24:302
15677991616,0cyclictest0-21swapper/021:04:310
1569099150,8cyclictest0-21swapper/320:14:313
15684991513,1cyclictest20642-21cut19:20:002
1568199150,1cyclictest0-21swapper/119:59:331
15690991414,0cyclictest0-21swapper/319:10:183
1569099140,14cyclictest0-21swapper/320:16:113
1569099140,0cyclictest0-21swapper/320:03:083
1569099140,0cyclictest0-21swapper/319:25:543
15684991414,0cyclictest0-21swapper/219:25:242
1568499140,14cyclictest0-21swapper/219:10:202
1568199140,14cyclictest0-21swapper/120:23:481
1568199140,14cyclictest0-21swapper/119:10:151
1568199140,0cyclictest0-21swapper/119:15:511
1567799140,14cyclictest0-21swapper/020:51:060
1567799140,14cyclictest0-21swapper/020:41:160
1567799140,14cyclictest0-21swapper/019:55:410
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional