You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-09 - 03:49

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot6s.osadl.org (updated Sun Aug 09, 2026 00:43:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
163672116105,6sleep00-21swapper/019:07:000
16558211195,11sleep30-21swapper/319:09:283
16351211189,16sleep10-21swapper/119:06:491
16452210089,6sleep20-21swapper/219:08:072
184232810,1sleep3381ktimersoftd/322:34:203
184232810,1sleep3381ktimersoftd/322:34:193
275682780,1sleep0101ktimersoftd/020:56:000
156982700,1sleep30-21swapper/300:09:193
71192330,0sleep10-21swapper/123:27:331
16627993010,2cyclictest0-21swapper/021:50:090
1662799291,3cyclictest14073-21ssh23:35:120
283422250,0sleep30-21swapper/323:49:343
1662799250,23cyclictest0-21swapper/023:55:020
140212250,4sleep01662799cyclictest21:56:160
1662799241,3cyclictest0-21swapper/020:50:000
1662799230,3cyclictest6949-21ssh22:21:540
1662799230,3cyclictest22694-21ssh22:38:180
1662799230,3cyclictest0-21swapper/023:01:060
1662799230,3cyclictest0-21swapper/022:01:030
1662799230,3cyclictest0-21swapper/021:36:550
1662799230,3cyclictest0-21swapper/021:17:230
59282220,1sleep30-21swapper/322:20:573
16628992219,2cyclictest32269-21diskmemload22:40:121
1662799220,3cyclictest4541-21perl00:30:150
1662799220,3cyclictest31676-21sed00:25:140
1662799220,3cyclictest28060-21sensors19:36:030
1662799220,3cyclictest24708-21grep22:40:150
1662799220,3cyclictest0-21swapper/023:15:150
1662799220,3cyclictest0-21swapper/021:42:110
1662799220,3cyclictest0-21swapper/021:11:110
1662799220,3cyclictest0-21swapper/020:15:190
1662799220,3cyclictest0-21swapper/000:39:550
1662799220,3cyclictest0-21swapper/000:23:030
1662799220,2cyclictest13326-21rm00:06:060
1662799220,2cyclictest0-21swapper/021:23:270
1662799220,2cyclictest0-21swapper/020:21:030
1663099211,18cyclictest0-21swapper/323:15:123
16630992110,3cyclictest24180-21apt-get22:40:123
16629992118,2cyclictest32684-21kworker/u8:221:25:052
16629992118,2cyclictest24074-21kworker/u8:222:08:042
16629992118,2cyclictest22460-21kworker/u8:121:17:032
16629992118,2cyclictest1702-21kworker/u8:223:26:052
16629992118,2cyclictest10345-21kworker/u8:221:59:042
1662999210,2cyclictest0-21swapper/220:45:132
1662999210,19cyclictest0-21swapper/222:00:122
16628992118,2cyclictest0-21swapper/119:40:111
1662799210,3cyclictest9343-21ssh22:56:590
1662799210,3cyclictest32269-21diskmemload23:33:270
1662799210,3cyclictest32200-21kernelversion23:20:150
1662799210,3cyclictest31008-21aten2.4_r3power19:45:130
1662799210,3cyclictest24562-21ssh00:17:470
1662799210,3cyclictest19413-21perl19:15:140
1662799210,3cyclictest17044-21perl00:10:150
1662799210,3cyclictest0-21swapper/023:53:590
1662799210,3cyclictest0-21swapper/023:27:460
1662799210,3cyclictest0-21swapper/022:05:190
1662799210,3cyclictest0-21swapper/000:00:060
1662799210,2cyclictest0-21swapper/023:07:350
1662799210,2cyclictest0-21swapper/022:50:150
1662799210,2cyclictest0-21swapper/022:10:430
1662799210,2cyclictest0-21swapper/021:46:350
16629992017,2cyclictest29220-21kworker/u8:000:33:052
16629992017,2cyclictest13102-21kworker/u8:100:07:052
1662999200,19cyclictest0-21swapper/223:10:112
1662999200,18cyclictest0-21swapper/223:55:022
1662999200,18cyclictest0-21swapper/200:10:112
1662899200,18cyclictest0-21swapper/120:35:121
1662799201,3cyclictest0-21swapper/022:48:480
16627992010,8cyclictest0-21swapper/020:10:190
1662799200,2cyclictest0-21swapper/023:47:430
1662799200,2cyclictest0-21swapper/023:41:270
1662799200,2cyclictest0-21swapper/023:14:270
1662799200,2cyclictest0-21swapper/022:31:030
1662799200,2cyclictest0-21swapper/022:31:030
1662799200,2cyclictest0-21swapper/022:27:270
1662799200,2cyclictest0-21swapper/022:27:270
1662799200,18cyclictest0-21swapper/021:30:110
1663099199,2cyclictest0-21swapper/321:47:163
1663099190,2cyclictest32269-21diskmemload21:30:163
1663099190,12cyclictest32269-21diskmemload23:06:033
16629991916,2cyclictest9109-21kworker/u8:021:20:052
16629991916,2cyclictest6567-21kworker/u8:000:15:052
16629991916,2cyclictest31651-21kworker/u8:122:28:052
16629991916,2cyclictest31651-21kworker/u8:122:28:042
16629991916,2cyclictest26567-21kworker/u8:023:22:042
16629991916,2cyclictest19014-21kworker/u8:119:18:042
1662999190,2cyclictest0-21swapper/223:40:112
16628991916,2cyclictest23535-21kworker/u8:223:57:051
264112180,1sleep20-21swapper/223:46:412
1663099181,2cyclictest0-21swapper/300:15:133
1663099180,2cyclictest22391-21munin-node3
1663099180,2cyclictest0-21swapper/319:45:133
16629991815,2cyclictest32476-21kworker/u8:219:39:042
16629991815,2cyclictest31651-21kworker/u8:122:40:022
16629991815,2cyclictest29364-21kworker/u8:121:42:042
16629991815,2cyclictest29220-21kworker/u8:000:27:052
16629991815,2cyclictest22460-21kworker/u8:121:07:052
16629991815,2cyclictest22460-21kworker/u8:120:58:052
16629991815,2cyclictest22110-21kworker/u8:022:20:052
16629991815,2cyclictest22110-21kworker/u8:022:17:052
16629991815,2cyclictest22110-21kworker/u8:021:37:052
16629991815,2cyclictest13102-21kworker/u8:100:24:022
16628991811,5cyclictest0-21swapper/123:12:041
1662799180,2cyclictest1338-21ssh22:16:110
1663099179,2cyclictest16920-21ssh23:37:223
1663099176,3cyclictest0-21swapper/319:50:143
1663099171,14cyclictest30080-21munin-node3
1663099171,14cyclictest0-21swapper/322:10:173
16629991714,2cyclictest6869-21kworker/u8:120:21:052
16629991714,2cyclictest6567-21kworker/u8:000:03:052
16629991714,2cyclictest30489-21kworker/u8:022:58:062
16629991714,2cyclictest29364-21kworker/u8:121:52:052
16629991714,2cyclictest28461-21kworker/u8:021:04:052
16628991712,3cyclictest0-21swapper/121:01:031
1662799171,3cyclictest274-21jbd2/sda1-819:35:010
1663099161,3cyclictest0-21swapper/319:11:053
1663099160,14cyclictest0-21swapper/320:54:543
16629991613,2cyclictest6869-21kworker/u8:120:25:042
16629991613,2cyclictest29364-21kworker/u8:121:45:052
16629991613,2cyclictest2605-21kworker/u8:220:14:042
16629991613,2cyclictest19014-21kworker/u8:119:28:032
1662899160,2cyclictest0-21swapper/119:10:131
1662799164,10cyclictest3127-21nscd19:21:010
1662799164,10cyclictest30258-21sh21:05:000
1662799163,3cyclictest3884-21cat19:56:040
1662799163,3cyclictest17766-21grep20:31:100
1662799163,3cyclictest15334-21processes20:25:200
1662799160,2cyclictest0-21swapper/020:03:060
1663099152,3cyclictest0-21swapper/319:25:003
16630991510,3cyclictest8379-21aten2.4_r3power20:10:133
1663099150,7cyclictest0-21swapper/319:32:023
1663099150,13cyclictest28449-21latency_hist21:00:003
16629991512,2cyclictest32476-21kworker/u8:219:21:052
16629991512,2cyclictest32476-21kworker/u8:219:12:012
16629991512,2cyclictest31651-21kworker/u8:122:36:022
16629991512,2cyclictest23535-21kworker/u8:223:53:052
16629991512,2cyclictest22460-21kworker/u8:121:10:052
1662999150,2cyclictest12030-21cpuspeed_turbos23:00:142
1662899151,12cyclictest30942-21apt-get19:45:121
1662899151,12cyclictest23504-21taskset21:34:131
16628991510,3cyclictest9431-21fschecks_time00:35:141
1662899150,13cyclictest0-21swapper/122:26:311
1662899150,13cyclictest0-21swapper/122:26:301
1662899150,13cyclictest0-21swapper/122:09:081
1662799154,9cyclictest6798-21aten2.4-expect20:05:120
1662799154,9cyclictest0-21swapper/019:10:200
1662799153,3cyclictest28938-21basename19:40:110
1662799153,3cyclictest20488-21aten2.4_r3power20:40:120
1662799152,3cyclictest23482-21awk19:25:170
1662799151,4cyclictest24959-21fschecks_time20:50:150
1662799151,3cyclictest3728-21runrttasks21:25:010
1662799151,3cyclictest3728-21runrttasks20:35:120
1662799151,3cyclictest0-21swapper/021:05:130
1662799151,3cyclictest0-21swapper/019:50:120
1663099149,3cyclictest0-21swapper/321:25:003
1663099142,9cyclictest0-21swapper/321:11:023
1663099141,3cyclictest9847-21fschecks_time22:25:163
1663099141,3cyclictest9847-21fschecks_time22:25:153
1663099141,2cyclictest21547-21smartctl20:41:013
1663099140,3cyclictest0-21swapper/323:30:193
1663099140,12cyclictest5518-21sed21:15:153
16629991411,2cyclictest29030-21kworker/u8:119:52:002
16629991411,2cyclictest14499-21kworker/u8:020:37:052
16629991411,2cyclictest0-21swapper/223:08:342
16629991410,2cyclictest14850-21ssh22:30:152
16629991410,2cyclictest14850-21ssh22:30:152
1662999140,3cyclictest3649-21snmpd19:45:192
1662999140,2cyclictest0-21swapper/221:33:542
1662999140,13cyclictest0-21swapper/223:33:142
1662899149,4cyclictest0-21swapper/122:13:101
1662899149,3cyclictest0-21swapper/123:00:551
1662899141,2cyclictest465-21sh23:54:051
16628991411,2cyclictest30489-21kworker/u8:022:49:041
16628991410,2cyclictest12718-21df_abs20:20:131
16628991410,2cyclictest0-21swapper/100:06:191
1662899140,3cyclictest0-21swapper/122:35:411
1662899140,2cyclictest0-21swapper/123:22:041
1662899140,2cyclictest0-21swapper/122:53:241
1662899140,12cyclictest32269-21diskmemload23:46:011
1662899140,12cyclictest0-21swapper/123:30:321
1662899140,12cyclictest0-21swapper/123:15:511
1662899140,12cyclictest0-21swapper/121:39:521
1662899140,12cyclictest0-21swapper/121:10:121
1662899140,12cyclictest0-21swapper/100:20:131
239402130,2sleep10-21swapper/100:16:521
1663099132,6cyclictest0-21swapper/300:40:003
1663099131,9cyclictest24846-21ssh23:12:593
1663099130,2cyclictest0-21swapper/321:50:573
1663099130,2cyclictest0-21swapper/300:01:023
16629991310,2cyclictest32625-21kworker/u8:019:58:042
16629991310,2cyclictest30489-21kworker/u8:022:47:042
16629991310,2cyclictest0-21swapper/200:36:332
1662999130,2cyclictest0-21swapper/223:36:432
1662999130,12cyclictest0-21swapper/223:17:442
1662999130,12cyclictest0-21swapper/222:51:142
1662999130,12cyclictest0-21swapper/222:11:242
16628991311,1cyclictest0-21swapper/122:23:131
16628991310,2cyclictest32684-21kworker/u8:221:22:051
16628991310,2cyclictest0-21swapper/122:56:021
16628991310,2cyclictest0-21swapper/122:17:411
16628991310,2cyclictest0-21swapper/121:56:001
16628991310,2cyclictest0-21swapper/121:53:111
16628991310,2cyclictest0-21swapper/120:55:061
16628991310,2cyclictest0-21swapper/120:00:151
16628991310,2cyclictest0-21swapper/119:51:041
16628991310,2cyclictest0-21swapper/119:26:051
1662899130,2cyclictest17175-21modprobe00:10:151
1662899130,2cyclictest0-21swapper/123:08:371
1662899130,2cyclictest0-21swapper/121:46:591
1662899130,2cyclictest0-21swapper/121:42:531
1662899130,2cyclictest0-21swapper/121:26:411
1662899130,2cyclictest0-21swapper/121:18:131
1662899130,12cyclictest0-21swapper/122:31:441
1662899130,12cyclictest0-21swapper/122:31:441
1662899130,12cyclictest0-21swapper/100:28:231
1662899130,11cyclictest0-21swapper/119:20:401
1662899130,11cyclictest0-21swapper/100:31:551
1663099129,2cyclictest32341-21ssh21:42:363
1663099129,2cyclictest0-21swapper/323:56:173
1663099129,2cyclictest0-21swapper/323:53:283
1663099123,6cyclictest0-21swapper/323:41:013
1663099122,7cyclictest0-21swapper/323:01:593
1663099122,7cyclictest0-21swapper/321:27:593
1663099122,6cyclictest0-21swapper/300:24:593
1663099120,3cyclictest25811-21ssh22:09:043
1663099120,2cyclictest0-21swapper/322:00:173
1663099120,2cyclictest0-21swapper/321:35:173
1663099120,2cyclictest0-21swapper/320:56:043
1663099120,11cyclictest0-21swapper/322:55:183
1663099120,11cyclictest0-21swapper/322:53:593
1663099120,11cyclictest0-21swapper/321:58:203
1663099120,11cyclictest0-21swapper/320:20:193
1663099120,11cyclictest0-21swapper/300:25:143
1663099120,11cyclictest0-21swapper/300:10:173
1662999120,2cyclictest0-21swapper/220:33:332
1662899129,2cyclictest0-21swapper/120:50:151
1662899129,2cyclictest0-21swapper/120:40:121
16628991210,1cyclictest0-21swapper/100:00:021
1662899120,2cyclictest0-21swapper/122:00:521
1662899120,2cyclictest0-21swapper/120:30:511
1662899120,2cyclictest0-21swapper/120:25:311
1662899120,2cyclictest0-21swapper/119:35:311
1662899120,2cyclictest0-21swapper/119:15:151
1662899120,11cyclictest0-21swapper/123:41:211
1662899120,11cyclictest0-21swapper/123:35:381
1662899120,11cyclictest0-21swapper/120:09:591
1662899120,10cyclictest0-21swapper/119:33:371
1663099118,2cyclictest0-21swapper/321:05:143
1663099117,2cyclictest0-21swapper/323:20:123
1663099116,3cyclictest0-21swapper/319:40:193
1663099112,6cyclictest0-21swapper/322:19:023
1663099111,7cyclictest0-21swapper/320:34:593
1663099110,10cyclictest0-21swapper/320:36:333
1662999118,2cyclictest0-21swapper/219:43:452
1662999112,6cyclictest0-21swapper/220:05:232
1662999110,2cyclictest0-21swapper/220:04:042
1662899110,9cyclictest0-21swapper/120:10:121
1662899110,3cyclictest0-21swapper/120:15:181
323312100,0sleep10-21swapper/121:09:591
1663099107,2cyclictest0-21swapper/323:25:053
1663099107,2cyclictest0-21swapper/319:56:023
1663099107,2cyclictest0-21swapper/319:24:143
1663099105,3cyclictest5020-21sed20:00:163
1663099105,3cyclictest12158-21sort20:20:003
1663099101,6cyclictest0-21swapper/320:25:163
1663099100,9cyclictest0-21swapper/300:32:013
1663099100,2cyclictest0-21swapper/322:36:143
1662999107,2cyclictest0-21swapper/220:53:432
1662899100,2cyclictest0-21swapper/119:55:151
20495290,0sleep20-21swapper/220:40:112
166309994,3cyclictest7558-21head20:05:183
166309990,6cyclictest0-21swapper/319:35:023
166309990,6cyclictest0-21swapper/319:16:023
166299991,6cyclictest0-21swapper/219:30:162
166289991,5cyclictest0-21swapper/120:47:591
11860290,2sleep20-21swapper/220:16:452
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional