You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-16 - 00:46

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot5s.osadl.org (updated Wed Apr 15, 2026 12:44:24)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
479099261,24cyclictest62550irq/127-eno110:52:140
480099250,24cyclictest7341-21ssh10:20:513
4795992523,2cyclictest8594-21ssh10:22:492
4795992523,1cyclictest20969-21sh10:04:252
479599250,24cyclictest0-21swapper/211:19:482
479599250,1cyclictest11868-21ssh10:56:372
4792992523,1cyclictest5776-21apt-get09:49:411
4792992523,1cyclictest0-21swapper/111:54:241
479299250,24cyclictest31357-21diskmemload09:22:271
479299250,24cyclictest23167-21idleruntime-cro12:10:001
479299250,24cyclictest0-21swapper/111:21:401
479299250,1cyclictest1955-21ssh10:47:141
479099250,0cyclictest0-21swapper/010:56:590
480099240,23cyclictest27842-21ssh10:40:033
480099240,23cyclictest0-21swapper/311:37:023
4795992423,1cyclictest31357-21diskmemload11:44:352
4795992423,1cyclictest0-21swapper/209:58:312
4792992423,1cyclictest31357-21diskmemload09:56:051
4792992421,2cyclictest495-21ssh11:17:211
479299241,22cyclictest607-21in:imuxsock07:55:011
479299240,23cyclictest31357-21diskmemload12:10:291
4790992422,1cyclictest0-21swapper/011:29:500
4790992422,1cyclictest0-21swapper/010:24:430
479099240,23cyclictest31357-21diskmemload10:36:170
479099240,23cyclictest31357-21diskmemload09:25:260
479099240,23cyclictest0-21swapper/011:39:110
479099240,1cyclictest0-21swapper/011:16:340
479099240,0cyclictest0-21swapper/009:21:280
4800992323,0cyclictest0-21swapper/312:13:423
4800992323,0cyclictest0-21swapper/311:22:453
4800992323,0cyclictest0-21swapper/310:33:393
4800992323,0cyclictest0-21swapper/310:26:443
4800992323,0cyclictest0-21swapper/310:01:093
4800992323,0cyclictest0-21swapper/309:15:383
4800992321,1cyclictest14616-21ssh09:57:253
4800992321,1cyclictest0-21swapper/310:10:013
4800992320,2cyclictest21902-21ssh11:06:123
4800992320,2cyclictest15331-21sh11:31:223
480099230,23cyclictest0-21swapper/311:59:313
480099230,23cyclictest0-21swapper/311:11:493
480099230,23cyclictest0-21swapper/309:36:393
480099230,22cyclictest9572-21awk07:20:003
480099230,22cyclictest7250-21sh12:26:133
480099230,22cyclictest32107-21ssh09:10:433
480099230,22cyclictest19947-21ssh09:30:233
480099230,22cyclictest12856-21sh09:55:003
480099230,0cyclictest31357-21diskmemload11:04:013
480099230,0cyclictest31357-21diskmemload10:59:493
480099230,0cyclictest31357-21diskmemload10:39:183
480099230,0cyclictest31357-21diskmemload10:10:513
480099230,0cyclictest0-21swapper/311:17:223
4795992323,0cyclictest0-21swapper/211:52:252
4795992323,0cyclictest0-21swapper/211:08:162
4795992320,0cyclictest0-21swapper/212:20:312
479599230,23cyclictest31357-21diskmemload10:44:212
479599230,23cyclictest0-21swapper/211:31:422
479599230,23cyclictest0-21swapper/210:50:122
479599230,23cyclictest0-21swapper/209:26:152
479599230,22cyclictest5061-21ssh09:48:302
479599230,22cyclictest25173-21ssh09:35:262
479599230,0cyclictest31357-21diskmemload09:13:312
479599230,0cyclictest0-21swapper/211:58:062
479599230,0cyclictest0-21swapper/211:48:102
479599230,0cyclictest0-21swapper/211:48:102
479599230,0cyclictest0-21swapper/211:03:022
4792992323,0cyclictest0-21swapper/112:00:441
4792992321,1cyclictest0-21swapper/112:16:111
4792992321,1cyclictest0-21swapper/111:26:211
4792992320,2cyclictest32025-21rm09:43:021
4792992320,2cyclictest16444-21sh11:00:401
479299230,2cyclictest25285-21sh09:35:361
479299230,2cyclictest2281-21ssh10:15:581
479299230,23cyclictest31357-21diskmemload10:20:031
479299230,23cyclictest31357-21diskmemload10:02:581
479299230,23cyclictest0-21swapper/112:36:321
479299230,23cyclictest0-21swapper/111:47:101
479299230,23cyclictest0-21swapper/111:47:101
479299230,23cyclictest0-21swapper/111:32:121
479299230,22cyclictest4055-21cron09:15:001
479299230,22cyclictest28747-21ssh11:13:531
479299230,22cyclictest106452sleep110:55:011
479299230,22cyclictest0-21swapper/112:21:511
479299230,22cyclictest0-21swapper/111:57:521
479299230,22cyclictest0-21swapper/110:05:291
479299230,0cyclictest31357-21diskmemload10:34:551
479299230,0cyclictest0-21swapper/109:53:001
4790992323,0cyclictest0-21swapper/011:06:420
4790992323,0cyclictest0-21swapper/009:50:540
4790992321,1cyclictest6539-21perf08:20:000
4790992321,1cyclictest62550irq/127-eno111:12:280
4790992321,1cyclictest0-21swapper/011:47:250
4790992321,1cyclictest0-21swapper/011:47:250
4790992321,1cyclictest0-21swapper/009:41:440
479099230,22cyclictest8264-21ssh09:19:440
479099230,22cyclictest31394-21sh12:19:330
479099230,22cyclictest25290-21sh09:35:360
479099230,22cyclictest2516-21sh10:48:040
479099230,22cyclictest0-21swapper/010:27:590
479099230,22cyclictest0-21swapper/007:29:390
479099230,0cyclictest31357-21diskmemload12:27:060
479099230,0cyclictest0-21swapper/011:22:460
479099230,0cyclictest0-21swapper/009:55:220
4800992222,0cyclictest0-21swapper/312:17:053
4800992222,0cyclictest0-21swapper/312:05:433
4800992222,0cyclictest0-21swapper/311:50:533
4800992221,0cyclictest10187-21apt-get07:24:393
4800992220,1cyclictest0-21swapper/309:20:243
480099220,22cyclictest1775-21ssh10:15:143
480099220,21cyclictest7776-21munin-run09:50:003
480099220,21cyclictest30515-21ssh09:40:403
480099220,21cyclictest17162-21ssh12:35:033
480099220,1cyclictest9812-21ssh11:25:403
480099220,1cyclictest3715-21apt-get08:15:023
480099220,1cyclictest0-21swapper/312:31:293
480099220,0cyclictest0-21swapper/310:45:513
4795992222,0cyclictest27090-21apt-get07:59:412
4795992222,0cyclictest0-21swapper/210:18:062
4795992221,0cyclictest0-21swapper/209:22:202
4795992220,2cyclictest0-21swapper/212:28:502
4795992220,1cyclictest0-21swapper/212:16:022
4795992219,2cyclictest23416-21ssh12:10:012
479599221,1cyclictest19301-21kworker/u8:111:35:322
479599220,2cyclictest21215-21ssh12:09:412
479599220,22cyclictest31357-21diskmemload10:45:102
479599220,22cyclictest23401-21ssh10:05:022
479599220,22cyclictest0-21swapper/212:04:582
479599220,21cyclictest9704-21ssh11:25:282
479599220,21cyclictest29225-21sh10:10:292
479599220,21cyclictest20794-21ssh09:31:382
479599220,21cyclictest0-21swapper/209:15:172
479599220,1cyclictest19736-21rm12:39:112
479599220,0cyclictest0-21swapper/211:14:032
479599220,0cyclictest0-21swapper/210:36:192
4792992222,0cyclictest0-21swapper/109:33:141
4792992222,0cyclictest0-21swapper/109:15:291
4792992221,1cyclictest12191-21ssh10:57:061
4792992220,1cyclictest0-21swapper/112:25:311
479299220,21cyclictest5376-21apt-get07:14:391
479299220,21cyclictest27819-21ssh10:40:021
479299220,21cyclictest24114-21ssh10:37:241
479299220,21cyclictest23929-21ssh11:09:271
479299220,21cyclictest0-21swapper/108:34:411
479299220,21cyclictest0-21swapper/108:34:411
479299220,1cyclictest20207-21ssh11:35:521
479299220,1cyclictest0-21swapper/112:30:311
479299220,1cyclictest0-21swapper/111:40:581
479299220,1cyclictest0-21swapper/110:26:081
4790992221,1cyclictest31357-21diskmemload11:59:450
4790992221,1cyclictest31357-21diskmemload10:04:180
479099221,21cyclictest62550irq/127-eno109:34:280
479099220,21cyclictest0-21swapper/012:38:060
479099220,21cyclictest0-21swapper/011:53:150
479099220,21cyclictest0-21swapper/011:30:210
479099220,21cyclictest0-21swapper/010:40:490
479099220,21cyclictest0-21swapper/010:15:200
479099220,21cyclictest0-21swapper/010:05:470
479099220,1cyclictest31357-21diskmemload11:43:060
479099220,1cyclictest0-21swapper/012:30:090
479099220,1cyclictest0-21swapper/012:10:480
479099220,1cyclictest0-21swapper/012:07:160
479099220,1cyclictest0-21swapper/011:02:170
479099220,1cyclictest0-21swapper/010:11:270
479099220,0cyclictest0-21swapper/012:21:230
4800992121,0cyclictest31357-21diskmemload12:01:183
4800992120,1cyclictest31053-21ssh11:46:403
4800992120,1cyclictest31053-21ssh11:46:403
4800992120,1cyclictest27152-21apt-get09:04:403
4800992119,1cyclictest24872-21rm11:40:043
480099210,20cyclictest0-21swapper/310:50:153
480099210,20cyclictest0-21swapper/307:14:393
480099210,1cyclictest29504-21apt-get08:04:403
480099210,1cyclictest0-21swapper/309:00:003
4795992121,0cyclictest0-21swapper/212:32:382
4795992121,0cyclictest0-21swapper/210:25:042
4795992121,0cyclictest0-21swapper/208:54:402
4795992121,0cyclictest0-21swapper/207:14:392
4795992120,1cyclictest7157-21apt-get08:24:402
4795992119,2cyclictest1649-21cron07:30:002
479599210,21cyclictest0-21swapper/210:30:482
479599210,21cyclictest0-21swapper/209:50:212
479599210,21cyclictest0-21swapper/209:42:102
479599210,1cyclictest22301-21apt-get07:49:412
479599210,1cyclictest19275-21idleruntime-cro07:40:012
479599210,0cyclictest0-21swapper/207:24:382
4792992121,0cyclictest0-21swapper/109:25:501
4792992121,0cyclictest0-21swapper/107:59:411
4792992120,0cyclictest7771-21apt-get07:19:391
4792992119,1cyclictest31955-21apt-get08:09:411
479299210,21cyclictest0-21swapper/110:10:431
479299210,0cyclictest0-21swapper/109:04:401
479299210,0cyclictest0-21swapper/108:04:401
479299210,0cyclictest0-21swapper/107:49:411
4790992120,1cyclictest23707-21apt-get08:55:020
4790992119,1cyclictest0-21swapper/009:45:040
479099210,20cyclictest0-21swapper/008:04:400
479099210,20cyclictest0-21swapper/007:39:410
479099210,1cyclictest0-21swapper/012:00:050
479099210,0cyclictest0-21swapper/008:44:390
479099210,0cyclictest0-21swapper/008:29:390
4800992020,0cyclictest0-21swapper/308:44:393
4800992020,0cyclictest0-21swapper/307:54:413
4800992019,0cyclictest0-21swapper/308:39:403
480099200,0cyclictest0-21swapper/307:29:393
4795992020,0cyclictest16129-21apt-get08:40:022
4795992020,0cyclictest11947-21apt-get08:34:402
4795992020,0cyclictest11947-21apt-get08:34:402
4795992020,0cyclictest0-21swapper/208:59:412
4795992019,1cyclictest0-21swapper/208:14:402
4795992018,1cyclictest21697-21munin-run07:45:012
479599200,0cyclictest0-21swapper/207:34:392
4792992020,0cyclictest0-21swapper/108:59:411
4792992020,0cyclictest0-21swapper/108:39:401
4792992018,1cyclictest8925-21turbostat08:25:001
4792992018,1cyclictest16761-21apt-get08:40:021
4792992018,1cyclictest0-21swapper/108:14:401
479299200,0cyclictest0-21swapper/109:09:411
479299200,0cyclictest0-21swapper/107:40:011
4790992020,0cyclictest21942-21apt-get08:54:400
4790992020,0cyclictest0-21swapper/009:09:410
4790992020,0cyclictest0-21swapper/009:04:400
4790992020,0cyclictest0-21swapper/007:49:410
4790992020,0cyclictest0-21swapper/007:19:390
4790992020,0cyclictest0-21swapper/007:14:390
479099200,0cyclictest0-21swapper/008:49:410
479099200,0cyclictest0-21swapper/008:14:400
4800991919,0cyclictest0-21swapper/309:09:413
4800991919,0cyclictest0-21swapper/308:34:413
4800991919,0cyclictest0-21swapper/308:34:413
4800991919,0cyclictest0-21swapper/307:49:413
4800991918,0cyclictest0-21swapper/308:49:413
4800991917,1cyclictest8935-21grep08:25:003
480099190,0cyclictest0-21swapper/308:09:413
4795991919,0cyclictest29546-21apt-get09:09:412
4795991919,0cyclictest0-21swapper/209:04:402
4795991919,0cyclictest0-21swapper/207:19:392
4795991918,1cyclictest26489-21munin-plugin-st07:55:012
479599190,0cyclictest0-21swapper/208:29:392
4792991919,0cyclictest0-21swapper/108:49:411
4792991919,0cyclictest0-21swapper/108:29:391
4790991919,0cyclictest0-21swapper/008:24:400
479099190,18cyclictest16134-21cat08:40:010
4800991815,2cyclictest3731-21munin-run08:15:003
4800991815,2cyclictest19278-21perf07:40:013
479299180,8cyclictest0-21swapper/108:19:401
4790991818,0cyclictest0-21swapper/007:34:400
4800991716,0cyclictest9546-21apt-get08:29:393
4792991717,0cyclictest0-21swapper/107:24:381
4790991715,1cyclictest1286-21cron08:10:000
4800991616,0cyclictest0-21swapper/308:54:403
4795991614,1cyclictest6540-21sendmail-msp08:20:002
4792991614,1cyclictest14375-21wc07:30:001
4792991614,1cyclictest0-21swapper/107:44:401
4790991616,0cyclictest0-21swapper/008:34:400
4790991616,0cyclictest0-21swapper/008:34:400
4800991514,1cyclictest0-21swapper/307:34:433
4800991513,1cyclictest28868-21turbostat.cron08:00:013
479599150,15cyclictest0-21swapper/208:04:392
4790991515,0cyclictest0-21swapper/007:59:410
480099140,14cyclictest0-21swapper/307:40:133
4795991414,0cyclictest0-21swapper/208:45:332
4795991414,0cyclictest0-21swapper/208:05:152
479599140,14cyclictest0-21swapper/208:37:132
479099140,14cyclictest0-21swapper/007:50:090
479099140,14cyclictest0-21swapper/007:40:150
479099140,14cyclictest0-21swapper/007:20:140
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional