You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-14 - 09:31

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Fri Aug 14, 2026 00:44:21)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1507992922,4cyclictest27578-21diskmemload21:53:012
1507992720,6cyclictest1042-21apt-get21:44:412
1507992622,3cyclictest0-21swapper/222:09:012
1507992620,5cyclictest7008-21ssh00:10:462
150799260,21cyclictest0-21swapper/220:40:002
150799260,0cyclictest0-21swapper/223:31:402
150799260,0cyclictest0-21swapper/223:26:592
151099250,24cyclictest27578-21diskmemload22:15:313
1507992523,2cyclictest0-21swapper/222:42:192
1507992521,4cyclictest27578-21diskmemload22:53:062
1507992521,3cyclictest0-21swapper/223:19:452
150799250,24cyclictest0-21swapper/223:36:382
150799250,24cyclictest0-21swapper/222:21:112
150799250,20cyclictest27578-21diskmemload00:07:112
150799250,1cyclictest22548-21df_inode21:34:422
150799250,1cyclictest21364-21apt-get19:54:402
150799250,1cyclictest0-21swapper/223:07:212
150799250,1cyclictest0-21swapper/222:27:192
150799250,1cyclictest0-21swapper/221:17:162
150799250,0cyclictest0-21swapper/200:37:462
1505992523,1cyclictest0-21swapper/120:00:011
1505992523,1cyclictest0-21swapper/100:18:321
150599250,0cyclictest0-21swapper/122:17:251
1500992523,1cyclictest0-21swapper/022:10:010
1510992422,1cyclictest0-21swapper/322:36:273
151099240,23cyclictest27578-21diskmemload22:07:073
151099240,23cyclictest27578-21diskmemload21:24:393
151099240,23cyclictest0-21swapper/322:40:513
151099240,23cyclictest0-21swapper/300:17:453
151099240,1cyclictest0-21swapper/321:40:093
1507992421,2cyclictest8660-21cat21:50:002
1507992420,3cyclictest27578-21diskmemload23:02:432
1507992420,3cyclictest0-21swapper/223:56:382
1507992420,3cyclictest0-21swapper/222:48:532
1507992420,3cyclictest0-21swapper/200:22:422
1507992420,0cyclictest0-21swapper/200:33:002
1507992419,4cyclictest27578-21diskmemload21:59:422
150799240,23cyclictest5148-21idleruntime-cro20:25:002
150799240,23cyclictest0-21swapper/223:44:042
150799240,23cyclictest0-21swapper/222:57:472
150799240,23cyclictest0-21swapper/222:04:242
150799240,23cyclictest0-21swapper/200:26:282
150799240,20cyclictest0-21swapper/222:11:422
150799240,20cyclictest0-21swapper/221:25:252
150799240,0cyclictest0-21swapper/223:54:572
150799240,0cyclictest0-21swapper/222:19:112
1505992422,1cyclictest10764-21sh21:52:361
150599240,24cyclictest27578-21diskmemload21:18:311
150599240,24cyclictest0-21swapper/123:26:031
150599240,24cyclictest0-21swapper/100:02:201
150599240,23cyclictest27578-21diskmemload23:50:171
150599240,0cyclictest0-21swapper/123:55:491
1500992423,1cyclictest17667-21ssh23:24:320
150099240,24cyclictest0-21swapper/022:17:050
150099240,23cyclictest27578-21diskmemload00:27:180
150099240,23cyclictest0-21swapper/000:05:160
150099240,0cyclictest27578-21diskmemload22:26:580
150099240,0cyclictest27578-21diskmemload00:37:300
150099240,0cyclictest0-21swapper/021:13:200
1510992323,0cyclictest0-21swapper/323:52:503
1510992323,0cyclictest0-21swapper/323:20:513
1510992323,0cyclictest0-21swapper/322:34:403
1510992322,1cyclictest75-21kswapd023:09:403
1510992322,1cyclictest27578-21diskmemload22:25:073
151099232,20cyclictest19459-21chrt00:22:283
1510992322,0cyclictest0-21swapper/323:25:033
1510992322,0cyclictest0-21swapper/300:27:313
1510992321,1cyclictest0-21swapper/323:42:113
1510992321,1cyclictest0-21swapper/323:15:303
1510992321,1cyclictest0-21swapper/322:52:453
151099230,23cyclictest0-21swapper/323:04:083
151099230,22cyclictest8254-21ssh00:12:333
151099230,22cyclictest3079-21latency_hist21:45:013
151099230,22cyclictest27578-21diskmemload22:01:153
151099230,22cyclictest2045-21diskmemload21:15:443
151099230,22cyclictest10442-21sh21:52:113
151099230,22cyclictest0-21swapper/323:34:443
151099230,22cyclictest0-21swapper/300:37:113
151099230,0cyclictest0-21swapper/323:12:143
151099230,0cyclictest0-21swapper/322:22:033
151099230,0cyclictest0-21swapper/300:09:153
1507992321,1cyclictest0-21swapper/220:30:022
150799230,22cyclictest27578-21diskmemload23:48:172
150799230,22cyclictest27578-21diskmemload00:02:302
150799230,22cyclictest0-21swapper/200:16:212
150799230,0cyclictest0-21swapper/221:10:142
1505992323,0cyclictest27578-21diskmemload22:29:581
1505992323,0cyclictest0-21swapper/123:14:191
1505992323,0cyclictest0-21swapper/122:55:191
1505992323,0cyclictest0-21swapper/122:49:221
1505992323,0cyclictest0-21swapper/121:31:431
1505992323,0cyclictest0-21swapper/100:25:111
1505992322,1cyclictest31174-21ssh22:09:511
1505992321,1cyclictest7565-21ssh00:11:411
1505992321,1cyclictest0-21swapper/123:17:551
1505992320,2cyclictest14737-21sh23:20:371
150599230,2cyclictest26614-21ssh23:31:261
150599230,23cyclictest0-21swapper/123:46:301
150599230,23cyclictest0-21swapper/122:30:321
150599230,23cyclictest0-21swapper/122:22:191
150599230,23cyclictest0-21swapper/121:55:481
150599230,23cyclictest0-21swapper/121:43:281
150599230,22cyclictest5979-21sh21:48:441
150599230,22cyclictest450-21rm23:36:431
150599230,22cyclictest0-21swapper/119:20:011
150599230,0cyclictest0-21swapper/123:40:071
150599230,0cyclictest0-21swapper/123:05:081
150599230,0cyclictest0-21swapper/122:13:451
150599230,0cyclictest0-21swapper/121:10:501
1500992323,0cyclictest27578-21diskmemload22:12:470
1500992323,0cyclictest0-21swapper/023:41:330
1500992323,0cyclictest0-21swapper/023:04:330
1500992322,0cyclictest23666-21apt-get22:04:400
1500992321,2cyclictest7283-21ssh00:11:200
1500992320,2cyclictest30111-21ssh00:31:250
1500992320,2cyclictest16683-21sh21:57:590
150099230,23cyclictest27578-21diskmemload22:44:060
150099230,23cyclictest0-21swapper/023:35:020
150099230,23cyclictest0-21swapper/021:25:440
150099230,23cyclictest0-21swapper/021:18:530
150099230,22cyclictest8315-21ssh21:21:170
150099230,22cyclictest4076-21diskmemload21:46:090
150099230,22cyclictest27578-21diskmemload22:35:050
150099230,22cyclictest25567-21munin-run20:00:010
150099230,22cyclictest22756-21ssh22:31:150
150099230,21cyclictest18996-21ssh22:55:510
150099230,1cyclictest15620-21unixbench_multi23:49:490
150099230,0cyclictest28204-21ssh23:33:390
150099230,0cyclictest0-21swapper/022:46:220
150099230,0cyclictest0-21swapper/021:43:270
150099230,0cyclictest0-21swapper/000:19:330
1510992222,0cyclictest0-21swapper/321:57:043
1510992222,0cyclictest0-21swapper/300:30:563
1510992221,1cyclictest27578-21diskmemload23:36:253
1510992221,1cyclictest21534-21sh22:59:223
1510992220,1cyclictest0-21swapper/323:55:183
1510992220,1cyclictest0-21swapper/320:15:013
151099220,21cyclictest5167-21munin-plugin-st20:25:003
151099220,21cyclictest27578-21diskmemload21:35:093
151099220,21cyclictest22812-21sleep21:00:013
151099220,21cyclictest16573-21apt-get19:44:393
151099220,21cyclictest0-21swapper/323:45:333
151099220,21cyclictest0-21swapper/321:26:073
151099220,21cyclictest0-21swapper/321:10:093
151099220,21cyclictest0-21swapper/300:00:123
151099220,1cyclictest0-21swapper/322:45:073
151099220,1cyclictest0-21swapper/322:11:543
151099220,1cyclictest0-21swapper/321:30:023
1507992221,1cyclictest0-21swapper/220:44:482
1507992220,2cyclictest0-21swapper/222:30:172
1507992220,1cyclictest0-21swapper/223:20:402
1507992220,1cyclictest0-21swapper/223:12:412
1507992220,1cyclictest0-21swapper/221:20:172
150799220,22cyclictest0-21swapper/221:35:172
150799220,21cyclictest0-21swapper/219:19:412
150799220,1cyclictest20763-21munin-run19:50:002
150799220,1cyclictest0-21swapper/222:36:332
1505992222,0cyclictest0-21swapper/120:29:391
1505992221,1cyclictest27578-21diskmemload22:35:011
1505992221,0cyclictest0-21swapper/121:04:381
150599220,22cyclictest0-21swapper/122:42:201
150599220,22cyclictest0-21swapper/100:36:561
150599220,21cyclictest25821-21apt-get21:09:411
150599220,21cyclictest25289-21rm23:01:431
150599220,21cyclictest24492-21ssh21:35:111
150599220,21cyclictest0-21swapper/100:30:551
150599220,1cyclictest20333-21ssh22:00:081
150599220,1cyclictest18217-21sh00:20:441
150599220,1cyclictest1281-21sh00:05:441
150599220,0cyclictest0-21swapper/122:54:401
1500992222,0cyclictest30986-21ssh23:06:400
1500992222,0cyclictest0-21swapper/021:53:540
1500992222,0cyclictest0-21swapper/021:35:100
1500992220,1cyclictest21810-21ssh23:55:040
150099220,21cyclictest3503-21ssh23:10:430
150099220,21cyclictest0-21swapper/021:30:050
150099220,1cyclictest8796-21ssh23:15:210
150099220,1cyclictest606-21dbus-daemon20:15:010
150099220,1cyclictest27654-21ssh00:00:010
150099220,1cyclictest21239-21sh23:26:410
150099220,1cyclictest20746-21grep19:50:000
1510992120,1cyclictest331rcuc/319:15:013
151099210,21cyclictest0-21swapper/319:49:403
151099210,20cyclictest0-21swapper/320:04:413
1507992119,1cyclictest0-21swapper/220:05:012
1505992121,0cyclictest0-21swapper/121:21:161
1505992120,1cyclictest0-21swapper/120:20:001
1505992119,1cyclictest32755-21latency_hist20:15:011
150599210,21cyclictest27959-21perf20:05:011
150599210,21cyclictest0-21swapper/121:25:191
150599210,0cyclictest0-21swapper/119:34:401
1500992120,1cyclictest0-21swapper/020:29:390
1500992119,1cyclictest22804-21ls21:00:010
150099210,20cyclictest0-21swapper/020:34:400
150099210,20cyclictest0-21swapper/020:19:400
150099210,20cyclictest0-21swapper/019:29:400
150099210,0cyclictest0-21swapper/022:50:210
1510992020,0cyclictest0-21swapper/319:54:403
1510992020,0cyclictest0-21swapper/319:29:403
1510992020,0cyclictest0-21swapper/319:24:393
151099200,0cyclictest0-21swapper/320:54:393
151099200,0cyclictest0-21swapper/319:19:413
1507992019,0cyclictest0-21swapper/220:14:402
1507992016,4cyclictest0-21swapper/219:14:402
150799200,0cyclictest21009-21apt-get20:59:392
1505992020,0cyclictest0-21swapper/120:59:391
1505992019,1cyclictest20747-21apt19:50:001
150599200,0cyclictest12756-21apt-get20:40:021
1500992020,0cyclictest0-21swapper/020:09:370
1500992020,0cyclictest0-21swapper/019:44:390
1500992020,0cyclictest0-21swapper/019:39:390
1500992020,0cyclictest0-21swapper/019:34:400
1500992019,1cyclictest4501-21apt-get19:19:410
1500992018,1cyclictest0-21swapper/020:25:000
1500992017,0cyclictest151rcu_preempt19:15:010
1510991919,0cyclictest0-21swapper/320:39:403
1510991917,1cyclictest7560-21munin-plugin-st20:30:003
1510991917,1cyclictest0-21swapper/319:34:403
1507991918,1cyclictest18342-21basename19:45:002
1505991919,0cyclictest0-21swapper/120:09:371
1500991919,0cyclictest0-21swapper/020:54:390
1510991818,0cyclictest0-21swapper/321:09:413
1510991818,0cyclictest0-21swapper/321:04:383
1510991818,0cyclictest0-21swapper/320:09:373
1510991817,1cyclictest13770-21apt-get20:44:393
1507991818,0cyclictest9310-21apt-get19:29:402
1507991818,0cyclictest0-21swapper/221:09:412
1505991818,0cyclictest0-21swapper/120:49:421
1505991818,0cyclictest0-21swapper/119:44:391
1505991818,0cyclictest0-21swapper/119:29:401
1505991817,0cyclictest0-21swapper/120:24:391
1500991818,0cyclictest26176-21apt-get20:04:410
1500991817,1cyclictest6916-21apt-get19:24:390
150099180,0cyclictest0-21swapper/021:04:440
1510991717,0cyclictest0-21swapper/320:49:413
1510991717,0cyclictest0-21swapper/320:19:403
1507991717,0cyclictest28565-21apt-get20:09:372
1507991717,0cyclictest0-21swapper/219:59:392
1507991716,0cyclictest0-21swapper/219:24:392
1507991714,3cyclictest0-21swapper/220:54:392
150799170,16cyclictest16168-21apt-get20:49:412
1505991717,0cyclictest0-21swapper/120:34:401
1500991717,0cyclictest0-21swapper/021:09:410
1510991616,0cyclictest0-21swapper/319:59:393
1507991614,1cyclictest7554-21sleep20:30:002
150799160,0cyclictest0-21swapper/219:34:222
1505991615,0cyclictest0-21swapper/119:39:391
1505991614,1cyclictest18615-21apt-get20:54:391
1500991616,0cyclictest0-21swapper/020:39:400
1500991615,1cyclictest0-21swapper/019:54:400
1507991513,1cyclictest23422-21apt-get21:04:382
150599150,1cyclictest3824-21users19:14:491
151099140,0cyclictest0-21swapper/319:35:513
150799140,0cyclictest0-21swapper/220:15:162
150799140,0cyclictest0-21swapper/219:35:172
1505991414,0cyclictest0-21swapper/119:50:011
150599140,0cyclictest0-21swapper/120:37:221
1500991414,0cyclictest0-21swapper/020:47:320
1500991414,0cyclictest0-21swapper/020:41:080
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional