You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-24 - 06:51

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Mon Aug 24, 2026 00:44:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2477199250,24cyclictest18397-21diskmemload21:14:193
24769992523,1cyclictest0-21swapper/222:57:282
2476999250,1cyclictest12392-21df_inode22:30:302
2475999250,24cyclictest18397-21diskmemload21:43:110
2475999250,1cyclictest0-21swapper/022:12:590
2477199240,24cyclictest18397-21diskmemload00:18:473
2477199240,23cyclictest18397-21diskmemload22:09:273
2477199240,23cyclictest18397-21diskmemload21:17:003
2477199240,1cyclictest25811-21apt-get21:45:293
2477199240,1cyclictest18397-21diskmemload23:54:043
2477199240,0cyclictest18397-21diskmemload21:58:153
24769992423,1cyclictest18397-21diskmemload21:31:332
2476999240,24cyclictest0-21swapper/222:01:442
2476999240,23cyclictest3748-21sh23:20:332
2476999240,23cyclictest18397-21diskmemload22:51:592
2476999240,23cyclictest0-21swapper/223:51:012
2476999240,23cyclictest0-21swapper/221:36:422
2476999240,23cyclictest0-21swapper/221:22:002
2476999240,1cyclictest19204-21ssh23:35:052
24761992423,1cyclictest18397-21diskmemload22:50:431
24761992422,1cyclictest31156-21latency_hist20:30:001
2476199240,24cyclictest18397-21diskmemload23:21:281
2476199240,24cyclictest0-21swapper/123:27:271
2476199240,24cyclictest0-21swapper/122:32:191
2476199240,0cyclictest0-21swapper/100:11:261
24759992421,2cyclictest6125-21find21:55:410
2475999240,24cyclictest0-21swapper/022:57:250
2475999240,24cyclictest0-21swapper/021:32:580
2475999240,23cyclictest7082-21ssh23:24:130
2475999240,23cyclictest19355-21rm00:03:510
2475999240,23cyclictest0-21swapper/023:31:150
2475999240,23cyclictest0-21swapper/023:10:520
2475999240,1cyclictest0-21swapper/023:56:300
24771992323,0cyclictest18397-21diskmemload21:30:333
24771992323,0cyclictest0-21swapper/323:41:303
24771992323,0cyclictest0-21swapper/323:35:413
24771992323,0cyclictest0-21swapper/300:10:023
2477199231,1cyclictest18397-21diskmemload21:35:433
2477199230,23cyclictest3798-21ssh21:54:563
2477199230,23cyclictest18397-21diskmemload22:52:183
2477199230,23cyclictest18397-21diskmemload22:27:163
2477199230,22cyclictest2319-21/usr/sbin/munin22:20:383
2477199230,22cyclictest18397-21diskmemload00:24:353
2477199230,22cyclictest12914-21ssh23:00:273
2477199230,0cyclictest19539-21ssh22:36:023
2477199230,0cyclictest18397-21diskmemload23:47:333
2477199230,0cyclictest18397-21diskmemload22:55:513
2477199230,0cyclictest18397-21diskmemload00:36:393
2477199230,0cyclictest13065-21ssh00:26:103
2477199230,0cyclictest0-21swapper/323:06:413
24769992323,0cyclictest0-21swapper/222:09:152
24769992323,0cyclictest0-21swapper/200:05:192
24769992321,1cyclictest30586-21ssh22:45:492
24769992321,1cyclictest28786-21sh22:15:362
24769992321,1cyclictest0-21swapper/200:17:432
2476999230,2cyclictest31182-21idleruntime-cro20:30:002
2476999230,23cyclictest22493-1kworker/u9:221:50:362
2476999230,23cyclictest0-21swapper/221:25:202
2476999230,23cyclictest0-21swapper/200:33:472
2476999230,22cyclictest8933-21ssh22:26:462
2476999230,22cyclictest4126-21ssh22:22:542
2476999230,22cyclictest24238-21ssh00:35:582
2476999230,22cyclictest21117-21sh23:06:462
2476999230,22cyclictest20836-21sh22:37:502
2476999230,22cyclictest0-21swapper/221:43:002
2476999230,0cyclictest0-21swapper/223:46:332
2476999230,0cyclictest0-21swapper/219:45:302
24761992323,0cyclictest0-21swapper/123:47:291
24761992323,0cyclictest0-21swapper/123:35:051
24761992323,0cyclictest0-21swapper/122:55:471
24761992323,0cyclictest0-21swapper/122:19:301
24761992323,0cyclictest0-21swapper/122:10:021
24761992323,0cyclictest0-21swapper/121:53:421
24761992322,1cyclictest25052-21chrt23:40:281
24761992321,1cyclictest0-21swapper/123:16:051
24761992321,1cyclictest0-21swapper/122:47:371
24761992321,1cyclictest0-21swapper/122:00:171
24761992321,1cyclictest0-21swapper/121:48:341
24761992321,1cyclictest0-21swapper/121:30:211
24761992320,2cyclictest16404-21ssh00:30:201
2476199230,2cyclictest8421-21sh22:26:071
2476199230,2cyclictest24121-21sh00:35:411
2476199230,2cyclictest15404-21sh22:05:061
2476199230,23cyclictest0-21swapper/123:30:101
2476199230,23cyclictest0-21swapper/123:12:331
2476199230,23cyclictest0-21swapper/122:43:371
2476199230,23cyclictest0-21swapper/100:20:311
2476199230,22cyclictest15838-21sh23:02:061
2476199230,22cyclictest0-21swapper/121:40:061
2476199230,0cyclictest0-21swapper/123:56:451
2476199230,0cyclictest0-21swapper/123:05:271
2476199230,0cyclictest0-21swapper/100:27:471
2476199230,0cyclictest0-21swapper/100:17:111
24759992323,0cyclictest0-21swapper/022:49:020
24759992323,0cyclictest0-21swapper/000:35:220
24759992321,1cyclictest31359-21apt-get21:50:290
24759992321,1cyclictest20025-21sh23:35:340
24759992321,1cyclictest0-21swapper/023:45:390
24759992321,1cyclictest0-21swapper/022:35:080
24759992321,1cyclictest0-21swapper/021:22:520
24759992321,1cyclictest0-21swapper/019:45:010
2475999231,21cyclictest62550irq/127-eno121:46:090
2475999230,23cyclictest0-21swapper/023:05:250
2475999230,23cyclictest0-21swapper/022:27:170
2475999230,22cyclictest3380-21ssh21:25:060
2475999230,22cyclictest18397-21diskmemload00:21:410
2475999230,22cyclictest0-21swapper/000:29:280
2475999230,1cyclictest13395-21ssh22:02:440
2475999230,1cyclictest0-21swapper/021:11:040
2475999230,0cyclictest18397-21diskmemload23:50:340
2475999230,0cyclictest18397-21diskmemload23:41:110
2475999230,0cyclictest0-21swapper/000:06:130
24771992222,0cyclictest18397-21diskmemload22:10:203
24771992221,1cyclictest3729-21apt-get21:25:303
24771992220,2cyclictest27832-21ssh23:13:213
24771992220,1cyclictest21861-21ntp_states00:05:383
24771992220,1cyclictest0-21swapper/320:10:003
24771992220,1cyclictest0-21swapper/300:00:213
2477199221,20cyclictest29581-21apt-get23:15:293
2477199220,2cyclictest27512-21diskmemload22:15:273
2477199220,22cyclictest26130-21ssh22:42:253
2477199220,22cyclictest0-21swapper/323:58:123
2477199220,22cyclictest0-21swapper/321:23:003
2477199220,22cyclictest0-21swapper/300:33:503
2477199220,21cyclictest3551-21sh20:40:013
2477199220,21cyclictest18397-21diskmemload22:00:143
2477199220,21cyclictest18397-21diskmemload21:40:543
2477199220,21cyclictest0-21swapper/322:31:223
2477199220,1cyclictest30897-21ssh22:46:123
2477199220,1cyclictest0-21swapper/323:20:353
2477199220,0cyclictest0-21swapper/323:28:003
24769992222,0cyclictest0-21swapper/221:56:022
24769992222,0cyclictest0-21swapper/221:46:072
24769992221,1cyclictest13170-21perf23:30:002
24769992220,1cyclictest0-21swapper/223:00:092
24769992220,1cyclictest0-21swapper/221:15:072
24769992219,2cyclictest17293-21ssh00:00:572
2476999220,21cyclictest5394-21apt-get00:20:302
2476999220,21cyclictest2596-21apt-get19:30:302
2476999220,21cyclictest23784-21ssh22:11:042
2476999220,21cyclictest23733-21ssh23:10:052
2476999220,21cyclictest18397-21diskmemload23:40:282
2476999220,21cyclictest13869-21ssh23:30:072
2476999220,21cyclictest0-21swapper/220:50:022
2476999220,21cyclictest0-21swapper/200:25:102
2476999220,21cyclictest0-21swapper/200:11:092
2476999220,1cyclictest27184-21rm22:43:542
2476999220,1cyclictest0-21swapper/223:56:002
2476999220,0cyclictest0-21swapper/223:17:112
2476999220,0cyclictest0-21swapper/219:15:022
24761992222,0cyclictest0-21swapper/121:20:281
24761992222,0cyclictest0-21swapper/119:45:301
24761992220,1cyclictest26676-21apt-get20:20:311
24761992220,1cyclictest0-21swapper/100:00:091
24761992219,2cyclictest9508-21awk19:45:011
2476199220,21cyclictest0-21swapper/121:55:411
2476199220,21cyclictest0-21swapper/121:15:091
2476199220,21cyclictest0-21swapper/119:35:301
2476199220,1cyclictest18419-21perf21:10:001
2476199220,1cyclictest17508-21apt-get22:35:291
2476199220,1cyclictest15239-21cat21:35:311
2476199220,1cyclictest0-21swapper/123:53:191
2476199220,1cyclictest0-21swapper/121:26:001
2476199220,1cyclictest0-21swapper/121:11:121
24759992222,0cyclictest0-21swapper/023:25:460
24759992222,0cyclictest0-21swapper/022:52:050
24759992222,0cyclictest0-21swapper/022:31:520
24759992220,1cyclictest13613-21latency_hist21:00:000
24759992220,1cyclictest0-21swapper/023:00:010
2475999220,21cyclictest25823-21apt-get00:10:020
2475999220,21cyclictest18400-21ssh21:10:000
2475999220,21cyclictest14755-21ssh21:35:190
2475999220,21cyclictest0-21swapper/022:05:290
2475999220,21cyclictest0-21swapper/021:00:300
2475999220,1cyclictest737-21rm23:18:040
2475999220,1cyclictest31313-21sh22:18:240
2475999220,1cyclictest2909-21sh00:17:200
2475999220,1cyclictest0-21swapper/020:50:010
2475999220,0cyclictest18397-21diskmemload22:40:090
2475999220,0cyclictest0-21swapper/021:15:290
24771992121,0cyclictest29069-21apt-get20:25:293
24771992120,1cyclictest9808-21apt-get19:45:303
2477199210,21cyclictest18397-21diskmemload23:32:183
2477199210,20cyclictest0-21swapper/319:15:283
2477199210,0cyclictest24247-21apt-get20:15:283
2477199210,0cyclictest0-21swapper/320:20:313
24769992120,1cyclictest31465-21apt-get20:30:292
24769992119,1cyclictest28-21ksoftirqd/220:50:012
24769992118,2cyclictest7109-21ls19:40:002
2476999210,20cyclictest1437-21apt-get20:35:292
2476999210,1cyclictest0-21swapper/220:20:002
2476999210,0cyclictest0-21swapper/219:40:302
24761992121,0cyclictest0-21swapper/119:15:021
2476199210,21cyclictest0-21swapper/100:05:551
2476199210,20cyclictest0-21swapper/120:55:311
24759992121,0cyclictest0-21swapper/000:30:060
24759992120,0cyclictest722-21apt-get22:20:290
24771992020,0cyclictest4996-21apt-get19:35:303
24771992020,0cyclictest0-21swapper/319:25:293
24771992018,1cyclictest0-21swapper/319:55:013
2477199200,0cyclictest0-21swapper/320:00:303
24769992020,0cyclictest0-21swapper/221:05:282
2476999200,0cyclictest0-21swapper/220:10:292
24761992019,1cyclictest26386-21perf20:20:001
2476199200,0cyclictest0-21swapper/120:35:291
24759992020,0cyclictest3867-21apt-get20:40:290
24759992020,0cyclictest0-21swapper/020:50:300
24759992018,1cyclictest609-21rs:main0
24759992018,1cyclictest0-21swapper/019:35:000
24759992017,2cyclictest32325-21dump-pmu-power19:25:000
2475999200,0cyclictest0-21swapper/019:35:300
24771991919,0cyclictest0-21swapper/320:40:293
24771991919,0cyclictest0-21swapper/320:30:293
24771991919,0cyclictest0-21swapper/319:30:303
24771991918,1cyclictest30214-21apt-get19:20:283
24769991917,1cyclictest12255-21apt-get19:50:302
24761991919,0cyclictest0-21swapper/120:50:021
24761991919,0cyclictest0-21swapper/120:30:301
24761991919,0cyclictest0-21swapper/119:30:301
24761991917,1cyclictest6266-21apt-get20:45:291
24759991919,0cyclictest27103-21apt-get19:15:020
24759991919,0cyclictest0-21swapper/019:55:010
24759991916,2cyclictest26372-21awk20:20:000
24771991818,0cyclictest14650-21apt-get19:55:293
24769991818,0cyclictest19458-21apt-get20:05:292
24769991818,0cyclictest0-21swapper/221:00:292
24769991817,1cyclictest11453-21apt-get20:55:312
24761991818,0cyclictest0-21swapper/120:10:291
24759991818,0cyclictest32609-21apt-get19:25:290
24759991818,0cyclictest0-21swapper/020:10:290
24759991817,0cyclictest0-21swapper/020:35:290
24769991717,0cyclictest0-21swapper/220:00:312
2476999170,0cyclictest0-21swapper/219:25:292
24759991717,0cyclictest0-21swapper/019:10:290
24771991616,0cyclictest21852-21apt-get20:10:293
24771991616,0cyclictest0-21swapper/319:40:293
24771991614,1cyclictest11157-21perf20:55:003
2477199160,0cyclictest0-21swapper/320:55:313
24769991614,1cyclictest0-21swapper/219:55:372
24761991614,1cyclictest0-21swapper/119:10:341
24759991616,0cyclictest0-21swapper/020:00:310
24771991515,0cyclictest0-21swapper/321:05:293
24771991515,0cyclictest0-21swapper/320:45:293
2477199150,1cyclictest13921-21apt-get21:00:293
2477199150,14cyclictest0-21swapper/319:10:293
24769991514,0cyclictest25005-21apt-get19:10:302
2476999150,1cyclictest30855-21hddtemp_smartct19:20:312
24761991515,0cyclictest0-21swapper/121:00:291
24761991515,0cyclictest0-21swapper/119:50:301
24761991515,0cyclictest0-21swapper/119:25:291
24761991514,1cyclictest17067-21apt-get20:00:311
24761991514,0cyclictest0-21swapper/120:05:291
2476199150,1cyclictest0-21swapper/119:55:291
24759991515,0cyclictest0-21swapper/019:55:290
24759991513,1cyclictest28773-21apt20:25:000
24769991414,0cyclictest0-21swapper/220:20:312
2476999140,14cyclictest0-21swapper/220:40:132
2476199140,0cyclictest0-21swapper/119:20:131
24759991414,0cyclictest0-21swapper/020:30:210
2475999140,14cyclictest0-21swapper/020:05:170
2475999140,0cyclictest0-21swapper/019:45:220
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional