You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-20 - 11:07

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot5s.osadl.org (updated Fri Mar 20, 2026 00:44:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
843399260,25cyclictest0-21swapper/222:16:422
843499250,24cyclictest45522sleep322:47:273
843399250,24cyclictest26478-21ssh22:04:502
843399250,24cyclictest0-21swapper/223:15:242
843299250,24cyclictest18270-21ssh00:34:281
8431992523,1cyclictest23257-21latency_hist23:05:010
843199250,24cyclictest11660-21ssh21:50:170
8434992422,1cyclictest2094-21diskmemload21:22:453
8434992422,1cyclictest0-21swapper/322:38:273
8434992421,2cyclictest17658-21latency_hist20:35:003
843499240,24cyclictest0-21swapper/322:16:443
843499240,23cyclictest4329-21munin-run22:15:003
843499240,23cyclictest19352-21sh23:32:323
843499240,23cyclictest11229-21ssh23:57:263
843499240,23cyclictest11229-21ssh23:57:263
843499240,23cyclictest0-21swapper/323:20:313
843499240,23cyclictest0-21swapper/323:11:333
843499240,23cyclictest0-21swapper/322:22:363
843499240,1cyclictest24787-21ssh00:10:013
8433992423,1cyclictest2094-21diskmemload23:21:222
8433992423,0cyclictest0-21swapper/223:43:592
843399240,23cyclictest31404-21switchtime23:12:352
843399240,23cyclictest0-21swapper/223:01:212
843399240,23cyclictest0-21swapper/222:52:562
843399240,23cyclictest0-21swapper/222:24:252
843399240,23cyclictest0-21swapper/221:59:012
843399240,23cyclictest0-21swapper/220:12:262
843399240,23cyclictest0-21swapper/200:30:102
843399240,23cyclictest0-21swapper/200:25:472
843399240,23cyclictest0-21swapper/200:22:412
843399240,23cyclictest0-21swapper/200:05:492
843399240,1cyclictest2094-21diskmemload21:41:142
843399240,0cyclictest0-21swapper/222:34:142
8432992424,0cyclictest0-21swapper/121:12:211
8432992422,1cyclictest0-21swapper/123:38:271
843299240,23cyclictest27868-21sh23:41:361
8431992424,0cyclictest0-21swapper/000:12:340
8431992423,0cyclictest19791-21ssh00:36:430
843199241,22cyclictest0-21swapper/022:55:000
843199240,24cyclictest0-21swapper/023:16:210
843199240,23cyclictest8509-21ssh21:16:370
843199240,23cyclictest18570-21perf00:35:000
843199240,23cyclictest18155-21ssh21:25:460
843199240,23cyclictest17904-21ssh21:57:050
8434992323,0cyclictest2094-21diskmemload21:37:573
8434992323,0cyclictest0-21swapper/300:15:563
8434992321,1cyclictest31904-21apt-get22:42:263
843499230,2cyclictest5932-21awk00:22:353
843499230,23cyclictest0-21swapper/322:32:163
843499230,23cyclictest0-21swapper/322:05:043
843499230,23cyclictest0-21swapper/321:58:473
843499230,22cyclictest26835-21munin-run23:40:003
843499230,22cyclictest22209-21seq22:00:443
843499230,22cyclictest2094-21diskmemload23:45:363
843499230,22cyclictest18318-21ssh00:02:443
843499230,22cyclictest16409-21turbostat21:55:013
843499230,22cyclictest11979-21sh23:26:073
843499230,0cyclictest0-21swapper/323:03:303
8433992322,1cyclictest0-21swapper/221:12:342
8433992322,0cyclictest0-21swapper/223:48:482
8433992321,1cyclictest2094-21diskmemload22:12:082
8433992321,1cyclictest0-21swapper/222:43:042
8433992321,1cyclictest0-21swapper/221:54:112
8433992321,1cyclictest0-21swapper/221:21:462
843399230,23cyclictest0-21swapper/222:56:492
843399230,22cyclictest21926-21ssh23:35:072
843399230,22cyclictest2094-21diskmemload00:01:242
843399230,22cyclictest0-21swapper/223:31:572
843399230,0cyclictest0-21swapper/223:56:382
843399230,0cyclictest0-21swapper/223:56:382
843399230,0cyclictest0-21swapper/223:09:402
843399230,0cyclictest0-21swapper/222:06:252
843399230,0cyclictest0-21swapper/221:29:212
843399230,0cyclictest0-21swapper/200:35:022
8432992323,0cyclictest0-21swapper/123:16:211
8432992323,0cyclictest0-21swapper/122:38:101
8432992323,0cyclictest0-21swapper/122:33:331
8432992323,0cyclictest0-21swapper/121:50:171
8432992323,0cyclictest0-21swapper/121:26:121
8432992323,0cyclictest0-21swapper/121:15:071
8432992322,1cyclictest14900-21if_eno121:22:301
8432992322,0cyclictest0-21swapper/123:33:241
8432992322,0cyclictest0-21swapper/123:05:011
8432992321,1cyclictest21528-21munin-run22:00:011
843299230,23cyclictest0-21swapper/123:21:551
843299230,23cyclictest0-21swapper/122:51:301
843299230,22cyclictest991-21/usr/sbin/munin22:12:261
843299230,22cyclictest28732-21ssh21:35:441
843299230,22cyclictest28436-21cron19:50:001
843299230,22cyclictest2094-21diskmemload00:15:491
843299230,22cyclictest19383-21rm00:04:291
843299230,22cyclictest0-21swapper/122:25:301
843299230,0cyclictest0-21swapper/122:15:161
8431992323,0cyclictest2094-21diskmemload21:45:490
8431992323,0cyclictest2094-21diskmemload00:08:370
8431992323,0cyclictest0-21swapper/021:20:170
8431992322,1cyclictest2094-21diskmemload23:56:260
8431992322,1cyclictest2094-21diskmemload23:56:260
8431992322,1cyclictest0-21swapper/022:06:030
8431992321,2cyclictest4742-21ssh23:50:070
8431992321,1cyclictest20398-21ssh23:33:070
843199230,23cyclictest2094-21diskmemload22:11:340
843199230,23cyclictest2094-21diskmemload21:32:590
843199230,23cyclictest0-21swapper/023:20:380
843199230,22cyclictest62550irq/127-eno122:01:420
843199230,22cyclictest622-21gdbus22:30:010
843199230,22cyclictest458-21sh21:39:450
843199230,22cyclictest22522-21ssh23:36:080
843199230,22cyclictest22317-21ssh22:32:290
843199230,1cyclictest9719-21ssh22:20:100
843199230,1cyclictest29749-21ssh23:12:140
8434992222,0cyclictest0-21swapper/321:49:563
8434992222,0cyclictest0-21swapper/321:41:583
8434992221,1cyclictest0-21swapper/323:42:413
8434992220,1cyclictest23569-21sh21:31:193
8434992220,1cyclictest0-21swapper/323:50:283
8434992220,1cyclictest0-21swapper/322:25:163
8434992220,1cyclictest0-21swapper/321:25:383
843499220,22cyclictest2094-21diskmemload21:12:273
843499220,21cyclictest8113-21diskmemload22:50:083
843499220,21cyclictest7978-21sh21:15:513
843499220,21cyclictest2094-21diskmemload00:30:033
843499220,21cyclictest2094-21diskmemload00:25:093
843499220,21cyclictest0-21swapper/322:55:183
843499220,21cyclictest0-21swapper/321:02:263
843499220,1cyclictest24858-21apt-get23:07:263
843499220,1cyclictest2357-21diskmemload23:17:023
843499220,1cyclictest0-21swapper/319:57:263
843499220,1cyclictest0-21swapper/300:10:253
8433992222,0cyclictest2094-21diskmemload00:11:022
8433992222,0cyclictest0-21swapper/221:32:222
8433992222,0cyclictest0-21swapper/221:16:262
8433992222,0cyclictest0-21swapper/221:02:262
843399220,21cyclictest26074-21idleruntime-cro19:45:002
843399220,21cyclictest15684-21ssh22:26:382
843399220,21cyclictest10922-21apt-get20:22:272
843399220,21cyclictest0-21swapper/222:46:462
843399220,21cyclictest0-21swapper/221:35:292
843399220,1cyclictest0-21swapper/223:25:512
843399220,1cyclictest0-21swapper/221:45:152
8432992222,0cyclictest2094-21diskmemload21:43:291
8432992222,0cyclictest0-21swapper/122:05:551
8432992221,1cyclictest14588-21apt-get22:57:261
8432992220,2cyclictest28563-21ssh23:10:171
8432992220,1cyclictest25694-21ssh00:10:241
843299220,22cyclictest0-21swapper/123:56:081
843299220,22cyclictest0-21swapper/123:56:081
843299220,22cyclictest0-21swapper/123:50:051
843299220,22cyclictest0-21swapper/122:20:101
843299220,22cyclictest0-21swapper/122:00:411
843299220,21cyclictest2094-21diskmemload00:20:161
843299220,21cyclictest10488-21sendmail-msp20:20:011
843299220,21cyclictest0-21swapper/123:07:261
843299220,21cyclictest0-21swapper/122:46:121
843299220,21cyclictest0-21swapper/119:15:021
843299220,1cyclictest26208-21sh21:32:391
843299220,1cyclictest15710-21apt-get20:32:271
843299220,1cyclictest0-21swapper/121:47:351
8431992222,0cyclictest2094-21diskmemload00:17:020
8431992222,0cyclictest0-21swapper/000:01:050
8431992221,1cyclictest62550irq/127-eno122:36:120
8431992221,1cyclictest1039-21ssh21:40:090
8431992220,1cyclictest24248-21ssh23:06:340
843199220,2cyclictest27218-21sh23:40:280
843199220,22cyclictest6480-21ssh21:13:490
843199220,22cyclictest5887-21ssh22:17:120
843199220,22cyclictest2094-21diskmemload00:21:270
843199220,22cyclictest0-21swapper/022:57:260
843199220,21cyclictest0-21swapper/022:45:250
843199220,21cyclictest0-21swapper/019:32:250
843199220,1cyclictest2094-21diskmemload23:25:030
843199220,1cyclictest18422-21perf19:30:010
843199220,1cyclictest0-21swapper/000:29:000
8434992120,1cyclictest25363-21apt-get20:52:243
8434992120,1cyclictest0-21swapper/321:07:263
8434992119,1cyclictest8063-21latency_hist20:15:013
843499210,20cyclictest0-21swapper/319:52:283
8433992121,0cyclictest0-21swapper/200:16:182
8433992120,1cyclictest2094-21diskmemload23:50:102
843399210,20cyclictest0-21swapper/220:52:242
843399210,20cyclictest0-21swapper/219:47:252
843399210,20cyclictest0-21swapper/219:30:022
8432992120,1cyclictest3704-21apt-get20:07:271
8432992120,1cyclictest11674-21ssh23:25:401
8432992120,0cyclictest0-21swapper/121:07:251
843299210,21cyclictest0-21swapper/123:45:421
843299210,21cyclictest0-21swapper/100:25:471
843299210,20cyclictest0-21swapper/119:22:241
843299210,0cyclictest0-21swapper/120:12:261
843299210,0cyclictest0-21swapper/119:42:251
843299210,0cyclictest0-21swapper/100:05:131
8431992121,0cyclictest0-21swapper/023:45:260
8431992121,0cyclictest0-21swapper/019:17:270
8431992120,0cyclictest0-21swapper/020:32:270
8431992119,1cyclictest860-21perf20:00:010
843199210,21cyclictest0-21swapper/022:41:100
843199210,21cyclictest0-21swapper/019:37:260
843199210,0cyclictest0-21swapper/020:07:270
8434992020,0cyclictest0-21swapper/320:02:273
8434992020,0cyclictest0-21swapper/319:22:243
8434992019,1cyclictest0-21swapper/320:42:273
8434992019,0cyclictest0-21swapper/320:57:273
8434992018,1cyclictest10485-21munin-run20:20:013
843499200,19cyclictest15248-21sh20:30:003
8433992020,0cyclictest0-21swapper/221:07:252
8433992020,0cyclictest0-21swapper/220:07:272
8433992020,0cyclictest0-21swapper/219:57:252
8433992019,0cyclictest8506-21apt-get20:17:272
843399200,0cyclictest0-21swapper/219:12:252
8432992020,0cyclictest8857-21apt-get19:12:251
8432992020,0cyclictest0-21swapper/120:47:271
8432992020,0cyclictest0-21swapper/119:32:251
843299200,19cyclictest0-21swapper/119:37:251
8431992020,0cyclictest0-21swapper/020:27:250
843199200,20cyclictest0-21swapper/019:12:250
8434991919,0cyclictest0-21swapper/319:47:253
8434991919,0cyclictest0-21swapper/319:32:253
8433991918,0cyclictest0-21swapper/220:27:252
843399190,19cyclictest0-21swapper/220:32:272
8432991919,0cyclictest16459-21apt-get19:27:251
8432991918,0cyclictest13313-21apt-get20:27:251
8432991917,1cyclictest606-21dbus-daemon20:00:011
843199192,16cyclictest805-21cron20:00:010
8431991919,0cyclictest0-21swapper/020:52:250
8431991919,0cyclictest0-21swapper/020:17:270
8431991919,0cyclictest0-21swapper/019:22:240
8431991918,1cyclictest10922-21apt-get20:22:270
8431991917,1cyclictest606-21dbus-daemon21:05:010
8434991818,0cyclictest0-21swapper/319:12:253
8433991818,0cyclictest21703-21apt-get19:37:252
8433991818,0cyclictest0-21swapper/220:47:272
8432991818,0cyclictest0-21swapper/120:52:251
843299180,17cyclictest30177-21apt-get21:02:271
843299180,17cyclictest20524-21apt-get20:42:271
8431991818,0cyclictest0-21swapper/020:57:260
8431991818,0cyclictest0-21swapper/019:52:280
8431991817,1cyclictest18106-21apt-get20:37:260
8431991816,1cyclictest22517-21awk20:45:000
8434991717,0cyclictest0-21swapper/320:47:273
8434991717,0cyclictest0-21swapper/320:37:263
8434991717,0cyclictest0-21swapper/319:37:263
8434991716,1cyclictest0-21swapper/319:27:253
8434991714,2cyclictest12541-21/usr/sbin/munin20:22:373
8433991717,0cyclictest0-21swapper/219:17:272
8433991716,1cyclictest0-21swapper/220:02:272
8432991716,1cyclictest1299-21apt-get20:02:271
8431991717,0cyclictest22972-21apt-get20:47:270
8431991717,0cyclictest0-21swapper/019:47:260
8434991616,0cyclictest0-21swapper/320:07:273
8432991616,0cyclictest27760-21apt-get20:57:261
8432991616,0cyclictest0-21swapper/120:22:271
8432991616,0cyclictest0-21swapper/119:52:281
8431991615,0cyclictest24118-21apt-get19:42:250
8433991515,0cyclictest0-21swapper/219:52:282
843499140,14cyclictest0-21swapper/319:41:353
843499140,0cyclictest0-21swapper/319:16:363
843399140,14cyclictest0-21swapper/220:55:292
843399140,14cyclictest0-21swapper/220:40:092
843399140,14cyclictest0-21swapper/220:36:022
843399140,14cyclictest0-21swapper/219:25:152
843399140,14cyclictest0-21swapper/219:20:522
8431991414,0cyclictest0-21swapper/021:05:030
843199140,0cyclictest0-21swapper/020:10:520
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional