You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-19 - 16:28

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Fri Jun 19, 2026 12:44:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3045299260,25cyclictest24057-21rm10:10:042
3044599260,25cyclictest22934-21ssh10:09:250
3045599250,24cyclictest4693-21ssh12:22:273
3045599250,24cyclictest4693-21ssh12:22:273
30452992523,1cyclictest1272-21ssh09:48:492
3045299250,24cyclictest23812-21diskmemload09:10:182
30450992522,2cyclictest14998-21grep07:45:011
3044599250,24cyclictest23812-21diskmemload11:52:150
3044599250,24cyclictest23812-21diskmemload10:49:390
30455992423,0cyclictest28647-21apt-get11:45:063
30455992422,1cyclictest23528-21ssh11:10:043
30455992421,2cyclictest12123-21ssh11:29:463
3045599240,2cyclictest22786-21sh11:39:443
3045599240,24cyclictest0-21swapper/310:29:013
3045599240,23cyclictest6236-21sh09:22:403
3045599240,23cyclictest17238-21sh11:04:053
3045599240,23cyclictest0-21swapper/312:11:493
3045599240,23cyclictest0-21swapper/309:15:243
3045599240,23cyclictest0-21swapper/309:15:243
30452992423,1cyclictest11123-21ssh11:59:012
30452992423,0cyclictest0-21swapper/211:14:112
3045299240,23cyclictest23812-21diskmemload09:16:102
3045299240,23cyclictest23812-21diskmemload09:16:102
3045299240,23cyclictest22476-21ssh10:38:272
3045299240,23cyclictest0-21swapper/210:26:142
3045299240,23cyclictest0-21swapper/209:50:062
3045299240,22cyclictest7914-21sh12:25:122
30450992423,1cyclictest0-21swapper/109:48:241
3045099242,21cyclictest3226-21ssh11:50:161
3045099240,24cyclictest23812-21diskmemload12:18:171
3045099240,24cyclictest23812-21diskmemload09:50:421
3045099240,24cyclictest0-21swapper/110:08:381
3045099240,23cyclictest28596-21idleruntime-cro11:15:001
3045099240,23cyclictest23812-21diskmemload11:25:571
3045099240,23cyclictest18504-21apt-get10:35:051
3045099240,0cyclictest23812-21diskmemload12:12:041
30445992422,1cyclictest11636-21ssh10:28:130
30445992422,1cyclictest0-21swapper/012:21:250
30445992422,1cyclictest0-21swapper/012:21:250
30445992421,2cyclictest22695-21rm10:38:440
3044599240,24cyclictest0-21swapper/009:30:240
3044599240,23cyclictest62550irq/127-eno111:12:170
3044599240,23cyclictest0-21swapper/012:06:350
3044599240,23cyclictest0-21swapper/011:35:490
3044599240,1cyclictest23812-21diskmemload09:16:460
3044599240,1cyclictest23812-21diskmemload09:16:460
3044599240,0cyclictest23812-21diskmemload11:19:330
30455992323,0cyclictest23812-21diskmemload12:07:493
30455992323,0cyclictest0-21swapper/309:54:283
30455992321,1cyclictest6827-21apt-get11:55:063
30455992321,1cyclictest5483-21apt-get07:25:033
30455992321,1cyclictest23156-21sh10:09:433
30455992321,1cyclictest12652-21apt-get11:30:063
30455992321,1cyclictest0-21swapper/312:38:593
30455992321,1cyclictest0-21swapper/310:30:093
30455992320,2cyclictest23812-21diskmemload12:25:523
3045599230,2cyclictest18145-21sh09:34:383
3045599230,2cyclictest11738-21ssh09:58:293
3045599230,22cyclictest31539-21ssh12:16:593
3045599230,22cyclictest23812-21diskmemload09:35:063
3045599230,22cyclictest23812-21diskmemload09:25:143
3045599230,22cyclictest0-21swapper/312:31:383
3045599230,22cyclictest0-21swapper/312:00:293
3045599230,22cyclictest0-21swapper/310:19:153
3045599230,22cyclictest0-21swapper/309:40:433
3045599230,1cyclictest20438-21sh10:35:223
3045599230,0cyclictest23812-21diskmemload11:20:103
3045599230,0cyclictest23812-21diskmemload10:11:133
3045599230,0cyclictest23812-21diskmemload09:45:553
3045599230,0cyclictest0-21swapper/311:43:003
3045599230,0cyclictest0-21swapper/311:08:433
30452992323,0cyclictest23812-21diskmemload11:05:462
30452992323,0cyclictest0-21swapper/212:09:112
30452992321,2cyclictest25653-21ssh11:41:072
30452992321,1cyclictest4733-21sh11:21:482
30452992321,1cyclictest13121-21apt-get10:00:072
30452992321,1cyclictest0-21swapper/209:20:132
30452992321,0cyclictest0-21swapper/210:46:432
30452992320,2cyclictest369-21awk07:15:002
30452992320,2cyclictest32757-21ssh11:18:152
30452992319,1cyclictest0-21swapper/212:30:032
3045299230,2cyclictest14925-21rm11:00:402
3045299230,23cyclictest0-21swapper/212:21:532
3045299230,23cyclictest0-21swapper/212:21:532
3045299230,23cyclictest0-21swapper/212:10:132
3045299230,22cyclictest23022-21rm09:38:502
3045299230,22cyclictest2106-21/usr/sbin/munin10:50:132
3045299230,1cyclictest0-21swapper/210:43:422
3045299230,0cyclictest23812-21diskmemload10:34:202
3045299230,0cyclictest0-21swapper/212:15:142
3045299230,0cyclictest0-21swapper/211:29:592
3045299230,0cyclictest0-21swapper/210:59:022
30450992323,0cyclictest23812-21diskmemload12:30:481
30450992323,0cyclictest0-21swapper/112:38:161
30450992323,0cyclictest0-21swapper/112:22:271
30450992323,0cyclictest0-21swapper/112:22:271
30450992323,0cyclictest0-21swapper/111:00:261
30450992323,0cyclictest0-21swapper/109:16:351
30450992323,0cyclictest0-21swapper/109:16:351
30450992321,1cyclictest26699-21ssh10:11:251
30450992321,1cyclictest24569-21sh08:05:001
30450992321,1cyclictest23812-21diskmemload11:56:061
30450992321,1cyclictest0-21swapper/110:30:011
3045099230,2cyclictest5019-21ssh10:21:291
3045099230,2cyclictest15043-21ssh11:31:101
3045099230,23cyclictest23812-21diskmemload11:20:591
3045099230,23cyclictest0-21swapper/112:08:011
3045099230,23cyclictest0-21swapper/111:48:211
3045099230,22cyclictest5392-21sh10:52:261
3045099230,22cyclictest27243-21apt-get08:10:071
3045099230,22cyclictest23812-21diskmemload10:25:561
3045099230,22cyclictest23812-21diskmemload09:30:431
3045099230,22cyclictest23812-21diskmemload09:27:351
3045099230,22cyclictest21059-21sh09:35:541
3045099230,1cyclictest29455-21ssh10:15:061
3045099230,1cyclictest10034-21ssh10:56:251
3045099230,1cyclictest0-21swapper/109:55:071
30445992323,0cyclictest0-21swapper/012:35:590
30445992323,0cyclictest0-21swapper/011:47:530
30445992323,0cyclictest0-21swapper/009:23:410
30445992323,0cyclictest0-21swapper/009:12:310
30445992322,1cyclictest23812-21diskmemload11:00:080
3044599232,1cyclictest62550irq/127-eno110:32:520
30445992321,1cyclictest0-21swapper/012:02:290
30445992321,1cyclictest0-21swapper/011:55:160
3044599230,2cyclictest26930-21ssh09:41:430
3044599230,22cyclictest712-21ssh10:18:050
3044599230,22cyclictest23812-21diskmemload12:27:060
3044599230,22cyclictest15682-21ssh10:01:240
3044599230,22cyclictest0-21swapper/011:25:130
3044599230,22cyclictest0-21swapper/010:40:180
3044599230,1cyclictest313-21systemd-journal08:35:010
3044599230,1cyclictest10519-21ssh10:57:040
3044599230,0cyclictest23812-21diskmemload11:20:300
3044599230,0cyclictest0-21swapper/012:33:250
3044599230,0cyclictest0-21swapper/010:50:130
3044599230,0cyclictest0-21swapper/010:20:270
30455992220,1cyclictest2410-21ssh10:20:073
30455992220,1cyclictest13852-21munin-run08:50:013
30455992220,1cyclictest0-21swapper/310:55:113
30455992219,2cyclictest3584-21chrt11:50:373
3045599220,22cyclictest0-21swapper/309:13:223
3045599220,21cyclictest29206-21apt-get10:45:063
3045599220,21cyclictest23812-21diskmemload10:42:583
3045599220,21cyclictest0-21swapper/307:20:063
3045599220,1cyclictest4340-21sh10:50:543
3045599220,1cyclictest13077-21ssh10:00:053
3045599220,0cyclictest0-21swapper/311:19:193
30452992222,0cyclictest0-21swapper/212:01:372
30452992220,1cyclictest0-21swapper/211:35:052
30452992220,1cyclictest0-21swapper/209:31:192
30452992220,1cyclictest0-21swapper/209:25:342
30452992220,1cyclictest0-21swapper/209:10:012
30452992219,2cyclictest30576-21ntp_states10:15:122
3045299220,2cyclictest7317-21ssh10:24:552
3045299220,21cyclictest9766-21ssh09:55:342
3045299220,21cyclictest0-21swapper/211:51:202
3045299220,21cyclictest0-21swapper/211:45:442
3045299220,21cyclictest0-21swapper/209:40:072
3045299220,21cyclictest0-21swapper/208:15:002
3045299220,21cyclictest0-21swapper/208:10:002
3045299220,1cyclictest19538-21ssh10:05:112
30450992222,0cyclictest23812-21diskmemload10:43:001
30450992222,0cyclictest0-21swapper/112:25:051
30450992220,1cyclictest23812-21diskmemload12:00:091
30450992220,1cyclictest0-21swapper/109:10:021
3045099220,21cyclictest23812-21diskmemload11:15:051
3045099220,21cyclictest0-21swapper/109:40:021
3045099220,21cyclictest0-21swapper/107:15:001
3045099220,1cyclictest23812-21diskmemload11:36:311
3045099220,1cyclictest23812-21diskmemload09:20:171
3045099220,1cyclictest0-21swapper/110:46:151
3045099220,1cyclictest0-21swapper/110:03:041
3045099220,1cyclictest0-21swapper/108:05:061
30445992222,0cyclictest0-21swapper/009:57:270
30445992222,0cyclictest0-21swapper/009:45:030
30445992221,1cyclictest20552-21ssh11:06:030
30445992220,1cyclictest8955-21/usr/sbin/munin09:25:100
30445992219,2cyclictest0-21swapper/010:10:150
3044599220,21cyclictest20696-21rm09:35:230
3044599220,21cyclictest0-21swapper/011:30:090
3044599220,21cyclictest0-21swapper/009:50:070
3044599220,1cyclictest22909-21ssh12:10:070
3044599220,0cyclictest0-21swapper/012:16:560
3044599220,0cyclictest0-21swapper/011:40:280
30455992120,1cyclictest0-21swapper/308:50:063
3045599210,0cyclictest18646-21apt-get09:00:023
3045299210,20cyclictest606-21dbus-daemon08:55:002
3045299210,20cyclictest0-21swapper/208:25:072
3045299210,1cyclictest16494-21apt-get08:55:062
30450992120,1cyclictest17640-21apt-get07:50:061
30450992119,1cyclictest4184-21perf08:30:011
3045099210,20cyclictest3093-21apt-get07:20:061
3045099210,20cyclictest0-21swapper/107:30:061
3045099210,0cyclictest0-21swapper/109:00:081
30445992121,0cyclictest0-21swapper/007:55:060
30445992121,0cyclictest0-21swapper/007:50:060
30445992119,1cyclictest141rcuc/008:10:000
3044599210,0cyclictest0-21swapper/008:40:070
30455992020,0cyclictest24846-21apt-get08:05:063
30455992020,0cyclictest0-21swapper/308:30:093
30452992018,1cyclictest12851-21apt-get07:40:052
3045299200,0cyclictest0-21swapper/209:00:022
3045299200,0cyclictest0-21swapper/208:00:052
30450992020,0cyclictest14098-21apt-get08:50:061
30450992020,0cyclictest0-21swapper/108:20:071
3045099200,0cyclictest0-21swapper/107:45:061
30445992020,0cyclictest0-21swapper/009:05:070
30445992020,0cyclictest0-21swapper/008:20:070
30445992020,0cyclictest0-21swapper/008:10:060
30455991919,0cyclictest0-21swapper/308:35:073
30455991919,0cyclictest0-21swapper/308:25:073
30455991919,0cyclictest0-21swapper/308:00:053
30455991919,0cyclictest0-21swapper/307:50:063
30455991919,0cyclictest0-21swapper/307:40:063
30455991919,0cyclictest0-21swapper/307:35:073
30455991917,1cyclictest334-21cron07:15:003
30452991919,0cyclictest0-21swapper/208:35:072
30452991919,0cyclictest0-21swapper/208:00:012
30452991919,0cyclictest0-21swapper/207:50:062
30452991919,0cyclictest0-21swapper/207:30:062
30452991918,0cyclictest4448-21apt-get08:30:092
30450991919,0cyclictest0-21swapper/107:15:061
30445991919,0cyclictest0-21swapper/008:55:060
30452991818,0cyclictest15248-21apt-get07:45:062
30452991817,1cyclictest0-21swapper/208:40:072
30452991816,1cyclictest32065-21apt-get08:20:072
30450991818,0cyclictest0-21swapper/109:05:081
30450991816,1cyclictest13811-21cron08:50:011
30445991818,0cyclictest0-21swapper/008:25:070
30445991818,0cyclictest0-21swapper/008:15:050
30445991818,0cyclictest0-21swapper/007:40:050
30445991818,0cyclictest0-21swapper/007:25:030
30455991717,0cyclictest0-21swapper/307:45:073
30452991716,1cyclictest31799-21latency_hist08:20:002
30450991717,0cyclictest0-21swapper/108:30:091
30450991717,0cyclictest0-21swapper/108:15:051
30445991717,0cyclictest0-21swapper/009:00:020
30445991717,0cyclictest0-21swapper/008:45:060
30455991614,1cyclictest9661-21expr08:40:083
30455991614,1cyclictest2808-21turbostat07:20:003
30452991616,0cyclictest0-21swapper/207:20:062
3045299160,15cyclictest10280-21apt-get07:35:072
30450991616,0cyclictest9258-21apt-get08:40:071
3045099160,1cyclictest7616-21latency_hist07:30:001
30445991616,0cyclictest30691-21apt-get07:10:060
30445991616,0cyclictest0-21swapper/007:35:070
30455991515,0cyclictest0-21swapper/309:10:003
30455991514,0cyclictest0-21swapper/308:10:073
30455991514,0cyclictest0-21swapper/307:30:073
30455991513,1cyclictest0-21swapper/308:15:123
30452991515,0cyclictest0-21swapper/207:25:032
30452991515,0cyclictest0-21swapper/207:15:062
30445991515,0cyclictest0-21swapper/007:20:060
30445991515,0cyclictest0-21swapper/007:15:080
30445991514,0cyclictest0-21swapper/008:50:060
30445991513,1cyclictest22630-21cpuspeed_turbos08:00:060
30455991413,0cyclictest20036-21apt-get07:55:053
3045599140,6cyclictest0-21swapper/308:20:073
3045599140,0cyclictest0-21swapper/308:58:203
30452991412,1cyclictest0-21swapper/208:45:142
30450991413,1cyclictest7996-21pmu-power08:35:141
3045099140,0cyclictest0-21swapper/107:55:251
30445991414,0cyclictest0-21swapper/007:45:030
30445991414,0cyclictest0-21swapper/007:30:490
3044599140,0cyclictest0-21swapper/008:36:430
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional