You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-04 - 05:35

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Fri Sep 04, 2026 00:44:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
10098992519,2cyclictest17902-21rm23:16:392
1009899250,1cyclictest25887-21ssh23:53:172
1009399250,24cyclictest0-21swapper/100:17:101
1009299250,24cyclictest0-21swapper/021:52:180
10100992424,0cyclictest0-21swapper/322:29:323
10100992423,1cyclictest32730-21ssh00:27:433
1010099240,23cyclictest5213-21sh21:39:193
1010099240,0cyclictest0-21swapper/323:19:093
10098992420,3cyclictest0-21swapper/222:50:162
1009899240,24cyclictest0-21swapper/223:59:112
1009899240,24cyclictest0-21swapper/222:17:172
1009899240,23cyclictest32127-21idleruntime-cro21:35:002
1009899240,23cyclictest150982sleep223:44:172
10093992423,1cyclictest0-21swapper/121:16:541
10093992422,1cyclictest0-21swapper/122:09:021
1009399240,24cyclictest0-21swapper/100:01:051
1009399240,23cyclictest12388-21cron22:15:011
1009399240,0cyclictest0-21swapper/121:48:361
10092992423,1cyclictest0-21swapper/000:27:110
10092992423,0cyclictest0-21swapper/021:34:160
1009299240,23cyclictest3686-21diskmemload23:16:450
1009299240,23cyclictest2498-21munin-run22:35:000
1009299240,23cyclictest12191-21if_err_eno123:41:300
1009299240,23cyclictest0-21swapper/022:47:050
1009299240,23cyclictest0-21swapper/021:41:360
1009299240,1cyclictest3686-21diskmemload22:24:500
10100992323,0cyclictest0-21swapper/323:34:073
10100992323,0cyclictest0-21swapper/322:48:313
10100992323,0cyclictest0-21swapper/300:23:053
10100992321,1cyclictest9327-21apt-get22:41:253
10100992321,1cyclictest0-21swapper/321:48:073
1010099231,1cyclictest12068-21rm22:14:283
1010099230,2cyclictest31716-21runrttasks22:02:153
1010099230,23cyclictest3686-21diskmemload21:55:023
1010099230,23cyclictest25631-21sh21:29:043
1010099230,23cyclictest0-21swapper/323:29:353
1010099230,23cyclictest0-21swapper/322:50:443
1010099230,22cyclictest9886-21ssh23:10:483
1010099230,22cyclictest8566-21sh23:38:023
1010099230,22cyclictest5750-21ssh00:04:153
1010099230,22cyclictest3686-21diskmemload23:03:023
1010099230,22cyclictest15245-21ssh23:44:283
1010099230,0cyclictest0-21swapper/300:14:083
10098992323,0cyclictest3686-21diskmemload00:08:032
10098992323,0cyclictest0-21swapper/222:10:082
10098992321,0cyclictest0-21swapper/222:21:232
10098992318,4cyclictest0-21swapper/222:05:052
1009899231,21cyclictest28-21ksoftirqd/220:15:002
1009899230,2cyclictest13590-21ssh21:17:452
1009899230,23cyclictest3686-21diskmemload23:05:312
1009899230,23cyclictest0-21swapper/223:48:542
1009899230,23cyclictest0-21swapper/223:38:092
1009899230,23cyclictest0-21swapper/223:13:442
1009899230,23cyclictest0-21swapper/222:31:502
1009899230,23cyclictest0-21swapper/222:04:452
1009899230,23cyclictest0-21swapper/221:59:022
1009899230,22cyclictest2822-21apt-get20:01:252
1009899230,22cyclictest27841-21ssh22:56:552
1009899230,22cyclictest24061-21ssh23:22:312
1009899230,22cyclictest23453-21ssh00:20:342
1009899230,22cyclictest21186-21ssh00:17:432
1009899230,22cyclictest16144-21ssh21:20:592
1009899230,22cyclictest1261-21ssh23:02:172
1009899230,22cyclictest0-21swapper/222:45:362
1009899230,1cyclictest12158-21ssh22:42:562
1009899230,0cyclictest0-21swapper/200:30:142
10093992323,0cyclictest3686-21diskmemload21:30:411
10093992323,0cyclictest0-21swapper/123:31:381
10093992323,0cyclictest0-21swapper/123:00:311
10093992323,0cyclictest0-21swapper/100:05:341
10093992322,1cyclictest0-21swapper/121:54:551
10093992321,1cyclictest0-21swapper/100:11:551
1009399230,2cyclictest25267-21apt19:40:011
1009399230,23cyclictest0-21swapper/123:37:481
1009399230,23cyclictest0-21swapper/122:45:101
1009399230,23cyclictest0-21swapper/122:26:021
1009399230,22cyclictest3713-21perf21:10:001
1009399230,22cyclictest3686-21diskmemload21:40:561
1009399230,22cyclictest3686-21diskmemload21:23:381
1009399230,22cyclictest0-21swapper/123:42:191
1009399230,22cyclictest0-21swapper/123:09:451
1009399230,22cyclictest0-21swapper/122:50:091
1009399230,22cyclictest0-21swapper/122:20:551
1009399230,22cyclictest0-21swapper/121:38:251
1009399230,22cyclictest0-21swapper/100:20:241
1009399230,0cyclictest0-21swapper/123:55:081
1009399230,0cyclictest0-21swapper/123:48:581
1009399230,0cyclictest0-21swapper/123:11:111
1009399230,0cyclictest0-21swapper/122:35:401
1009399230,0cyclictest0-21swapper/121:25:031
1009399230,0cyclictest0-21swapper/121:11:361
1009399230,0cyclictest0-21swapper/120:21:241
1009399230,0cyclictest0-21swapper/120:21:241
1009399230,0cyclictest0-21swapper/100:37:331
1009399230,0cyclictest0-21swapper/100:30:121
1009399230,0cyclictest0-21swapper/100:28:191
10092992323,0cyclictest3686-21diskmemload22:43:190
10092992323,0cyclictest0-21swapper/021:13:380
10092992323,0cyclictest0-21swapper/000:16:460
10092992322,1cyclictest62550irq/127-eno122:03:090
10092992322,1cyclictest28648-21ssh00:25:010
10092992322,1cyclictest0-21swapper/023:06:050
10092992321,1cyclictest15285-21munin-run21:20:010
10092992321,1cyclictest0-21swapper/023:38:330
10092992321,1cyclictest0-21swapper/023:22:560
10092992321,1cyclictest0-21swapper/022:10:470
10092992321,1cyclictest0-21swapper/000:37:150
1009299231,1cyclictest0-21swapper/022:39:020
1009299230,23cyclictest0-21swapper/023:59:030
1009299230,23cyclictest0-21swapper/023:11:100
1009299230,22cyclictest2474-21idleruntime-cro20:00:000
1009299230,22cyclictest24397-21rm22:25:590
1009299230,22cyclictest19331-21grep20:35:010
1009299230,22cyclictest0-21swapper/023:46:290
1009299230,22cyclictest0-21swapper/022:58:310
1009299230,22cyclictest0-21swapper/022:05:120
1009299230,22cyclictest0-21swapper/021:57:200
1009299230,22cyclictest0-21swapper/021:21:570
1009299230,1cyclictest6223-21idleruntime-cro00:05:000
1009299230,0cyclictest3686-21diskmemload23:03:560
1009299230,0cyclictest0-21swapper/000:34:020
10100992222,0cyclictest0-21swapper/322:55:183
10100992222,0cyclictest0-21swapper/321:50:153
10100992222,0cyclictest0-21swapper/321:32:043
10100992222,0cyclictest0-21swapper/300:30:093
10100992221,1cyclictest351-21apt-get19:56:253
10100992220,1cyclictest8883-21ssh21:41:433
10100992220,1cyclictest19500-21sh23:47:073
1010099220,22cyclictest0-21swapper/321:12:043
1010099220,21cyclictest7610-21apt-get20:11:253
1010099220,21cyclictest32436-21idleruntime-cro19:55:003
1010099220,21cyclictest2899-21ssh22:35:143
1010099220,21cyclictest26880-21apt-get20:51:243
1010099220,21cyclictest22418-21ssh23:21:293
1010099220,21cyclictest12105-21idleruntime-cro20:20:003
1010099220,21cyclictest0-21swapper/300:15:173
1010099220,21cyclictest0-21swapper/300:05:263
1010099220,1cyclictest3160-21apt-get23:05:023
1010099220,1cyclictest20823-21apt-get19:31:243
1010099220,1cyclictest20823-21apt-get19:31:243
1010099220,1cyclictest15215-21ssh21:19:583
1010099220,1cyclictest0-21swapper/322:05:573
1010099220,0cyclictest0-21swapper/323:50:323
1010099220,0cyclictest0-21swapper/322:22:333
10098992222,0cyclictest0-21swapper/223:31:042
10098992222,0cyclictest0-21swapper/200:12:212
10098992220,1cyclictest4569-21ssh21:10:472
10098992220,1cyclictest2499-21ntp_states21:36:342
1009899220,22cyclictest0-21swapper/223:26:222
1009899220,21cyclictest7965-21ssh00:35:172
1009899220,21cyclictest3686-21diskmemload22:26:252
1009899220,21cyclictest31183-21diskmemload00:26:302
1009899220,21cyclictest27668-21turbostat19:45:012
1009899220,1cyclictest1427-21sh00:00:442
1009899220,1cyclictest10017-21ssh21:43:112
1009899220,1cyclictest0-21swapper/221:25:092
1009899220,0cyclictest0-21swapper/221:50:172
1009899220,0cyclictest0-21swapper/221:45:152
10093992221,0cyclictest0-21swapper/121:55:041
10093992220,1cyclictest0-21swapper/123:15:221
10093992220,1cyclictest0-21swapper/122:41:061
1009399220,21cyclictest29861-21sh22:30:241
1009399220,21cyclictest0-21swapper/123:23:341
1009399220,21cyclictest0-21swapper/122:15:351
1009399220,21cyclictest0-21swapper/122:00:101
1009399220,21cyclictest0-21swapper/120:01:251
1009399220,21cyclictest0-21swapper/119:11:241
1009399220,1cyclictest3686-21diskmemload22:56:521
1009399220,1cyclictest21713-21turbostat20:40:011
1009399220,1cyclictest0-21swapper/123:26:371
10092992220,1cyclictest17344-21ls00:15:000
1009299220,21cyclictest5213-21apt-get20:06:230
1009299220,21cyclictest467-21ssh21:35:160
1009299220,21cyclictest0-21swapper/022:50:520
1009299220,21cyclictest0-21swapper/021:46:110
1009299220,21cyclictest0-21swapper/000:05:380
1009299220,1cyclictest3686-21diskmemload21:28:440
1009299220,1cyclictest0-21swapper/023:51:150
1009299220,1cyclictest0-21swapper/023:30:120
1009299220,1cyclictest0-21swapper/023:25:540
10100992121,0cyclictest0-21swapper/323:56:523
10100992119,2cyclictest19674-21rm21:23:243
1010099210,20cyclictest12980-21ssh22:15:283
1010099210,20cyclictest0-21swapper/320:26:253
1010099210,1cyclictest12486-21apt-get20:21:243
1010099210,1cyclictest12486-21apt-get20:21:243
1010099210,0cyclictest0-21swapper/300:35:103
10098992120,1cyclictest3021-21ssh22:35:242
1009899210,1cyclictest7247-21latency_hist20:10:002
1009899210,0cyclictest14881-21apt-get20:26:242
10093992120,0cyclictest0-21swapper/120:46:231
1009399210,0cyclictest0-21swapper/120:31:251
10092992121,0cyclictest0-21swapper/019:25:020
10092992120,0cyclictest0-21swapper/020:55:000
10092992119,2cyclictest15235-21cron19:20:000
10100992020,0cyclictest0-21swapper/319:41:223
10100992020,0cyclictest0-21swapper/319:21:223
10100992019,1cyclictest3721-21awk21:10:003
10100992018,1cyclictest21715-21idleruntime-cro20:40:013
1010099200,20cyclictest0-21swapper/320:41:253
10098992020,0cyclictest0-21swapper/220:56:232
10098992020,0cyclictest0-21swapper/219:56:252
10098992020,0cyclictest0-21swapper/219:16:232
1009899200,0cyclictest0-21swapper/219:10:012
10093992020,0cyclictest0-21swapper/120:56:231
10093992019,1cyclictest0-21swapper/119:31:241
10093992019,1cyclictest0-21swapper/119:31:241
10093992018,1cyclictest606-21dbus-daemon20:55:001
1009399201,17cyclictest20467-21perf19:30:011
10092992018,2cyclictest12139-21awk20:20:000
10100991919,0cyclictest29274-21apt-get20:56:233
10098991919,0cyclictest0-21swapper/219:26:252
10093991916,2cyclictest1287-21turbostat.cron21:05:001
10092991919,0cyclictest0-21swapper/021:06:260
10092991919,0cyclictest0-21swapper/020:01:250
10092991917,1cyclictest622-21gdbus20:30:010
10092991917,1cyclictest22094-21apt-get20:41:250
10100991818,0cyclictest17278-21apt-get20:31:253
10100991818,0cyclictest0-21swapper/319:36:253
10100991817,1cyclictest26514-21awk20:50:003
10098991818,0cyclictest0-21swapper/220:31:252
10098991818,0cyclictest0-21swapper/220:21:242
10098991818,0cyclictest0-21swapper/220:21:242
10098991816,1cyclictest30031-21cron19:50:012
10093991818,0cyclictest0-21swapper/119:46:241
10093991818,0cyclictest0-21swapper/119:21:221
10093991816,1cyclictest15286-21awk19:20:001
10093991816,1cyclictest0-21swapper/119:41:221
10092991818,0cyclictest0-21swapper/019:36:250
10092991818,0cyclictest0-21swapper/019:11:240
10092991814,3cyclictest31329-21awk21:00:000
10100991716,1cyclictest0-21swapper/320:08:443
1010099170,0cyclictest0-21swapper/319:10:013
10098991717,0cyclictest0-21swapper/220:16:232
10092991717,0cyclictest0-21swapper/021:01:240
10092991717,0cyclictest0-21swapper/020:46:230
10092991717,0cyclictest0-21swapper/019:31:240
10092991717,0cyclictest0-21swapper/019:31:240
10100991616,0cyclictest0-21swapper/320:01:253
1010099160,16cyclictest563-17auditd19:49:553
10098991616,0cyclictest0-21swapper/221:06:262
10098991616,0cyclictest0-21swapper/219:31:242
10098991616,0cyclictest0-21swapper/219:31:242
10098991614,1cyclictest31323-21memory19:51:292
1009899160,15cyclictest26576-21munin-run20:50:002
10093991616,0cyclictest0-21swapper/120:16:231
1009399160,15cyclictest9710-21munin-run20:15:001
1009399160,15cyclictest0-21swapper/119:51:251
10100991512,1cyclictest20516-21grep19:30:013
1010099150,0cyclictest31691-21apt-get21:01:243
10098991515,0cyclictest23216-21apt-get19:36:252
10098991515,0cyclictest0-21swapper/221:01:242
1009899150,14cyclictest0-21swapper/219:21:222
10093991514,1cyclictest16921-21munin-run20:30:011
10092991515,0cyclictest28024-21apt-get19:46:240
10098991414,0cyclictest0-21swapper/220:40:282
10098991414,0cyclictest0-21swapper/220:36:232
10098991413,1cyclictest0-21swapper/220:50:022
1009399140,14cyclictest0-21swapper/119:55:581
10092991414,0cyclictest0-21swapper/020:20:180
10092991414,0cyclictest0-21swapper/020:20:180
10092991414,0cyclictest0-21swapper/019:40:500
1009299140,14cyclictest0-21swapper/019:20:470
1009299140,0cyclictest0-21swapper/020:36:340
1009299140,0cyclictest0-21swapper/020:10:040
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional