You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-06 - 09:20

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack3slot6s.osadl.org (updated Mon Jul 06, 2026 00:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
253921400,0sleep30-21swapper/321:11:143
16140211797,12sleep10-21swapper/119:06:011
16492211595,15sleep00-21swapper/019:06:240
16686211179,5sleep30-21swapper/319:08:553
15875211187,16sleep20-21swapper/219:05:182
154492820,0sleep10-21swapper/122:35:181
196152810,1sleep10-21swapper/122:40:151
182262790,0sleep30-21swapper/322:04:293
103292750,1sleep30-21swapper/323:05:183
69662680,0sleep10-21swapper/123:36:301
310292590,4sleep11679999cyclictest21:42:191
310292590,4sleep11679999cyclictest21:42:191
214852510,1sleep021483-21ssh22:41:540
1679999380,19cyclictest0-21swapper/120:10:131
217542360,0sleep00-21swapper/022:07:350
218002340,1sleep20-21swapper/222:42:322
99952290,0sleep00-21swapper/020:11:010
296032240,0sleep20-21swapper/221:00:152
103092230,0sleep10-21swapper/121:20:141
53522220,1sleep2301ktimersoftd/200:10:182
1680099221,19cyclictest0-21swapper/221:30:122
174592210,1sleep2301ktimersoftd/200:24:212
1680199211,2cyclictest0-21swapper/322:05:143
16801992016,2cyclictest425-21diskmemload23:36:043
1680199200,18cyclictest0-21swapper/300:10:133
1679999200,18cyclictest425-21diskmemload23:05:111
1679999200,18cyclictest0-21swapper/100:10:121
174632190,1sleep20-21swapper/222:03:122
1680099190,4cyclictest0-21swapper/200:37:042
16801991811,5cyclictest2546-21ssh23:32:043
16800991815,2cyclictest29261-21kworker/u8:220:00:012
16800991815,2cyclictest23289-21kworker/u8:221:37:042
1680099180,16cyclictest0-21swapper/219:50:122
1680099180,13cyclictest0-21swapper/221:29:042
16801991714,2cyclictest13191-21kworker/u8:123:46:053
16801991712,3cyclictest16149-21ssh22:36:013
16800991714,2cyclictest3001-21kworker/u8:023:05:042
16800991714,2cyclictest29261-21kworker/u8:219:59:042
16800991714,2cyclictest26549-21kworker/u8:223:40:012
16800991714,2cyclictest24917-21kworker/u8:122:11:042
1680099170,12cyclictest0-21swapper/221:54:042
1679999172,6cyclictest0-21swapper/121:35:001
1680199161,3cyclictest0-21swapper/323:21:543
1680199161,13cyclictest29346-21munin-node3
1680199161,13cyclictest17504-21fschecks_time19:10:133
16800991613,2cyclictest715-21kworker/u8:121:12:042
16800991613,2cyclictest29261-21kworker/u8:220:06:042
16800991613,2cyclictest25479-21kworker/u8:123:00:012
16800991613,2cyclictest20520-21kworker/u8:119:23:042
16800991613,2cyclictest17172-21kworker/u8:019:12:042
1680099161,13cyclictest0-21swapper/222:45:112
1680199151,3cyclictest26886-21ssh22:48:343
16801991511,2cyclictest32164-21ssh22:54:513
1680199151,12cyclictest26231-21ssh22:12:143
1680199150,13cyclictest4023-21taskset22:23:553
1680199150,13cyclictest19667-21taskset23:50:313
16800991512,2cyclictest8095-21kworker/u8:219:26:042
16800991512,2cyclictest715-21kworker/u8:121:23:042
16800991512,2cyclictest30685-21kworker/u8:022:23:042
16800991512,2cyclictest23289-21kworker/u8:222:57:042
16800991512,2cyclictest13191-21kworker/u8:123:46:012
1680099150,13cyclictest425-21diskmemload23:16:392
1680099150,11cyclictest0-21swapper/219:42:042
1680099150,10cyclictest0-21swapper/223:55:042
1680099150,10cyclictest0-21swapper/221:55:042
1679999151,12cyclictest27192-21ssh00:35:061
1679999150,13cyclictest19160-21latency_hist21:30:001
1679899151,12cyclictest23104-21apt-get23:55:110
1679899151,12cyclictest0-21swapper/021:00:120
1679899150,13cyclictest32709-21munin-node0
16801991411,2cyclictest0-21swapper/322:16:553
16801991410,2cyclictest7799-21ntpq20:05:173
1680199140,2cyclictest0-21swapper/321:35:013
1680199140,2cyclictest0-21swapper/321:15:313
1680199140,2cyclictest0-21swapper/300:29:113
1680099149,3cyclictest25177-21unixbench_singl23:21:062
1680099149,3cyclictest0-21swapper/222:34:122
1680099142,7cyclictest425-21diskmemload21:20:002
1680099141,7cyclictest0-21swapper/220:30:002
16800991411,2cyclictest29261-21kworker/u8:220:19:042
16800991411,2cyclictest29221-21kworker/u8:021:08:042
16800991411,2cyclictest26549-21kworker/u8:223:52:042
16800991411,2cyclictest25707-21kworker/u8:119:35:042
16800991411,2cyclictest23289-21kworker/u8:221:48:042
16800991411,2cyclictest23289-21kworker/u8:221:48:042
16800991411,2cyclictest23145-21kworker/u8:120:56:042
16800991411,2cyclictest16699-21kworker/u8:120:32:042
16800991411,2cyclictest0-21swapper/222:25:592
16800991411,2cyclictest0-21swapper/200:15:592
1680099141,11cyclictest5944-21rm23:35:292
16799991411,2cyclictest0-21swapper/123:52:201
16799991411,2cyclictest0-21swapper/123:43:201
16799991411,2cyclictest0-21swapper/123:18:101
16799991411,2cyclictest0-21swapper/119:25:161
16799991411,2cyclictest0-21swapper/100:15:401
1679999141,10cyclictest425-21diskmemload00:30:121
1679999140,2cyclictest0-21swapper/123:47:301
1679999140,2cyclictest0-21swapper/123:24:001
1679999140,2cyclictest0-21swapper/122:05:101
1679999140,13cyclictest0-21swapper/123:28:501
1679999140,13cyclictest0-21swapper/100:06:501
1679999140,12cyclictest207150irq/24-eth123:01:171
1679999140,12cyclictest0-21swapper/100:00:111
16798991411,2cyclictest0-21swapper/019:10:130
1679899140,2cyclictest0-21swapper/020:50:130
1679899140,12cyclictest0-21swapper/023:13:520
149732140,2sleep0425-21diskmemload22:00:180
134822140,2sleep00-21swapper/000:20:030
191242130,9sleep019375-21diskstats20:35:140
1680199138,3cyclictest0-21swapper/322:56:223
16801991310,2cyclictest8183-21kworker/u8:221:26:043
16801991310,2cyclictest23289-21kworker/u8:221:44:043
16801991310,2cyclictest23289-21kworker/u8:221:44:033
16801991310,2cyclictest0-21swapper/323:42:443
16801991310,2cyclictest0-21swapper/321:50:313
16801991310,2cyclictest0-21swapper/321:47:113
16801991310,2cyclictest0-21swapper/321:47:113
16801991310,2cyclictest0-21swapper/319:45:133
16801991310,2cyclictest0-21swapper/319:25:143
16801991310,2cyclictest0-21swapper/300:20:213
1680199130,3cyclictest0-21swapper/321:20:573
1680199130,2cyclictest425-21diskmemload22:32:043
1680199130,2cyclictest26188-21ssh23:58:043
1680199130,2cyclictest0-21swapper/323:15:513
1680199130,2cyclictest0-21swapper/323:14:023
1680199130,2cyclictest0-21swapper/323:02:013
1680199130,2cyclictest0-21swapper/322:43:043
1680199130,2cyclictest0-21swapper/320:40:153
1680199130,2cyclictest0-21swapper/300:05:143
1680199130,12cyclictest0-21swapper/322:25:163
1680199130,12cyclictest0-21swapper/319:51:013
1680199130,12cyclictest0-21swapper/300:02:513
1680199130,11cyclictest425-21diskmemload21:31:333
1680099132,6cyclictest0-21swapper/219:30:002
1680099131,7cyclictest0-21swapper/220:25:002
16800991310,2cyclictest29261-21kworker/u8:220:44:042
16800991310,2cyclictest25479-21kworker/u8:123:10:012
16800991310,2cyclictest20646-21kworker/u8:020:47:042
16800991310,2cyclictest20646-21kworker/u8:020:39:042
16800991310,2cyclictest11367-21kworker/u8:022:35:042
16800991310,2cyclictest0-21swapper/222:07:092
16800991310,2cyclictest0-21swapper/220:50:152
16800991310,2cyclictest0-21swapper/200:31:022
1680099130,8cyclictest0-21swapper/222:15:042
1680099130,12cyclictest401-21ssh23:30:132
1680099130,12cyclictest0-21swapper/221:43:392
1680099130,12cyclictest0-21swapper/221:43:392
1680099130,12cyclictest0-21swapper/200:29:182
1680099130,12cyclictest0-21swapper/200:02:052
1679999138,3cyclictest0-21swapper/123:30:041
1679999131,3cyclictest0-21swapper/119:40:161
16799991310,2cyclictest425-21diskmemload22:05:001
16799991310,2cyclictest10923-21apt-get20:15:101
16799991310,2cyclictest0-21swapper/122:59:401
16799991310,2cyclictest0-21swapper/122:53:101
16799991310,2cyclictest0-21swapper/122:49:211
16799991310,2cyclictest0-21swapper/122:31:001
16799991310,2cyclictest0-21swapper/122:25:171
1679999130,2cyclictest0-21swapper/100:25:191
1679999130,12cyclictest0-21swapper/122:11:401
1679999130,12cyclictest0-21swapper/121:46:001
1679999130,12cyclictest0-21swapper/121:46:001
1679999130,11cyclictest6001-21hwlatdetect21:15:151
1679999130,11cyclictest0-21swapper/121:05:301
1679899138,3cyclictest8582-21ssh00:14:430
1679899138,3cyclictest31027-21ssh21:42:180
1679899138,3cyclictest31027-21ssh21:42:180
1679899133,6cyclictest0-21swapper/023:07:130
1679899131,2cyclictest0-21swapper/023:30:140
16798991310,2cyclictest0-21swapper/022:15:140
16798991310,2cyclictest0-21swapper/020:00:130
1679899130,2cyclictest425-21diskmemload21:50:190
1679899130,2cyclictest0-21swapper/021:14:130
1679899130,12cyclictest0-21swapper/021:45:130
1679899130,12cyclictest0-21swapper/021:45:130
1679899130,12cyclictest0-21swapper/021:31:030
1679899130,11cyclictest0-21swapper/019:45:150
1679899130,11cyclictest0-21swapper/000:35:030
136202130,2sleep00-21swapper/022:34:170
1680199129,2cyclictest0-21swapper/300:33:043
1680199122,6cyclictest0-21swapper/320:55:003
1680199122,6cyclictest0-21swapper/320:50:003
1680199120,2cyclictest0-21swapper/321:55:023
1680199120,2cyclictest0-21swapper/319:36:053
1680199120,2cyclictest0-21swapper/319:21:013
1680199120,2cyclictest0-21swapper/300:35:193
1680199120,11cyclictest0-21swapper/320:25:183
1680199120,11cyclictest0-21swapper/320:21:053
1680199120,11cyclictest0-21swapper/320:16:013
1680199120,11cyclictest0-21swapper/300:17:043
1680099129,2cyclictest0-21swapper/223:25:052
1680099129,2cyclictest0-21swapper/220:10:142
1680099129,2cyclictest0-21swapper/200:05:522
1680099122,7cyclictest0-21swapper/219:19:582
1680099120,11cyclictest0-21swapper/222:50:162
1679999129,2cyclictest0-21swapper/123:10:431
1679999129,2cyclictest0-21swapper/121:55:291
1679999129,2cyclictest0-21swapper/121:13:111
1679999129,2cyclictest0-21swapper/120:40:141
1679999129,2cyclictest0-21swapper/119:20:181
1679999127,3cyclictest19495-21fschecks_count19:15:131
1679999121,9cyclictest647-21munin-node1
1679999120,2cyclictest0-21swapper/123:57:211
1679999120,2cyclictest0-21swapper/122:15:021
1679999120,2cyclictest0-21swapper/121:53:551
1679999120,2cyclictest0-21swapper/120:50:191
1679999120,2cyclictest0-21swapper/119:30:001
1679999120,2cyclictest0-21swapper/100:22:111
1679999120,11cyclictest0-21swapper/121:32:161
1679999120,11cyclictest0-21swapper/120:31:021
1679999120,11cyclictest0-21swapper/119:10:131
1679999120,10cyclictest425-21diskmemload22:22:561
1679999120,10cyclictest0-21swapper/121:00:411
1679899129,2cyclictest0-21swapper/023:28:020
1679899129,2cyclictest0-21swapper/022:48:020
1679899129,2cyclictest0-21swapper/022:11:280
1679899127,3cyclictest31483-21ssh22:53:430
1679899121,9cyclictest30894-21munin-run19:45:000
1679899121,9cyclictest22386-21cron00:30:000
1679899120,3cyclictest0-21swapper/021:22:210
1679899120,2cyclictest3905-21ssh22:59:040
1679899120,2cyclictest0-21swapper/023:35:180
1679899120,2cyclictest0-21swapper/022:38:120
1679899120,2cyclictest0-21swapper/020:20:190
1679899120,1cyclictest0-21swapper/020:41:010
1679899120,11cyclictest0-21swapper/023:16:230
1679899120,11cyclictest0-21swapper/021:59:020
1679899120,11cyclictest0-21swapper/020:30:130
1679899120,11cyclictest0-21swapper/000:31:000
1679899120,11cyclictest0-21swapper/000:18:020
1679899120,11cyclictest0-21swapper/000:08:330
196302110,1sleep00-21swapper/023:50:290
1680199118,2cyclictest29261-21kworker/u8:220:00:053
1680199118,2cyclictest16699-21kworker/u8:120:31:043
1680199118,2cyclictest0-21swapper/321:00:153
1680199111,7cyclictest0-21swapper/320:38:023
1680199110,7cyclictest0-21swapper/319:43:583
1679999118,2cyclictest0-21swapper/120:35:501
1679999118,2cyclictest0-21swapper/119:55:181
1679999118,2cyclictest0-21swapper/119:45:001
1679999111,5cyclictest0-21swapper/120:10:001
1679999110,9cyclictest23012-21munin-node1
1679999110,9cyclictest0-21swapper/120:20:191
1679999110,9cyclictest0-21swapper/119:35:191
1679899118,2cyclictest0-21swapper/023:47:020
1679899118,2cyclictest0-21swapper/023:42:170
1679899118,2cyclictest0-21swapper/023:00:140
1679899118,2cyclictest0-21swapper/021:35:010
1679899118,2cyclictest0-21swapper/000:01:470
1679899117,2cyclictest0-21swapper/023:20:180
1679899110,1cyclictest0-21swapper/022:28:350
1679899110,10cyclictest0-21swapper/021:29:120
1679899110,10cyclictest0-21swapper/019:50:140
1680199107,2cyclictest29221-21kworker/u8:021:06:043
1680199105,3cyclictest9192-21cut20:10:143
1680199105,3cyclictest3649-21snmpd20:56:473
1680199100,8cyclictest0-21swapper/319:56:173
1679999100,8cyclictest0-21swapper/120:00:131
1679999100,3cyclictest0-21swapper/120:25:501
1679999100,2cyclictest0-21swapper/120:55:111
1679899107,2cyclictest0-21swapper/021:15:030
1679899107,2cyclictest0-21swapper/019:20:000
1679899101,7cyclictest0-21swapper/020:50:000
1679899100,6cyclictest0-21swapper/019:36:030
168019994,3cyclictest19262-21cpuspeed_turbos19:15:123
168019991,7cyclictest0-21swapper/319:31:593
168009994,3cyclictest32543-21unixbench_singl19:46:012
167989994,3cyclictest8832-21latency_hist20:10:000
167989994,3cyclictest31318-21sort21:05:130
167989994,3cyclictest25272-21egrep19:30:130
167989994,3cyclictest23508-21fschecks_count19:25:140
167989994,3cyclictest15373-21sort20:25:140
167989994,3cyclictest11556-21if_eth020:15:150
167989991,6cyclictest0-21swapper/020:56:000
167989990,8cyclictest0-21swapper/019:21:530
167989983,3cyclictest3268-21tr19:55:140
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional