You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-03 - 10:20

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack3slot6s.osadl.org (updated Wed Jun 03, 2026 00:43:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2783821380,1sleep00-21swapper/022:45:180
194972114103,6sleep00-21swapper/019:05:470
20021210897,6sleep20-21swapper/219:07:222
20131210695,6sleep30-21swapper/319:08:463
1952129780,12sleep10-21swapper/119:06:001
306512720,0sleep20-21swapper/222:48:522
138602710,0sleep00-21swapper/023:05:100
71772700,0sleep10-21swapper/123:31:011
253182700,1sleep2301ktimersoftd/200:24:012
273502640,1sleep337-21rcuc/321:38:153
2025499272,5cyclictest0-21swapper/121:58:011
226122260,1sleep10-21swapper/122:06:071
21112240,1sleep00-21swapper/000:33:290
2025499231,7cyclictest31812-21diskmemload22:20:121
135162220,1sleep012-21rcu_preempt22:30:230
84982210,0sleep30-21swapper/321:51:383
2025499181,6cyclictest0-21swapper/121:48:581
2025499171,5cyclictest0-21swapper/120:16:591
20254991713,2cyclictest0-21swapper/121:30:261
2025499171,2cyclictest0-21swapper/121:13:021
2025699161,13cyclictest0-21swapper/300:05:213
2025699160,14cyclictest0-21swapper/322:20:353
2025599160,14cyclictest6679-21grep21:50:162
2025499160,14cyclictest0-21swapper/123:14:211
2025699151,3cyclictest30433-21sensors_temp21:41:003
2025699151,2cyclictest0-21swapper/319:10:133
2025699151,12cyclictest3728-21runrttasks22:41:543
20256991511,2cyclictest0-21swapper/322:50:123
20256991510,3cyclictest17953-21iostat_ios22:35:163
20256991510,3cyclictest0-21swapper/321:16:053
2025699150,13cyclictest31104-21ssh22:49:353
2025599151,3cyclictest5267-21ssh21:49:072
20255991512,2cyclictest26696-21kworker/u8:223:18:052
20255991512,2cyclictest12593-21sh21:56:002
2025499152,7cyclictest0-21swapper/119:59:591
2025499151,2cyclictest9087-21apt-get23:00:111
20254991512,2cyclictest0-21swapper/123:38:511
2025499151,12cyclictest8641-21sensors_fan00:06:061
2025499151,12cyclictest0-21swapper/121:25:231
2025499151,12cyclictest0-21swapper/119:40:401
2025499151,12cyclictest0-21swapper/100:20:421
2025499150,13cyclictest31888-21cpu22:50:131
20253991512,2cyclictest31724-21ssh22:15:560
20253991510,3cyclictest5260-21ssh22:55:190
78322140,1sleep00-21swapper/020:10:010
2025699140,3cyclictest19945-21ssh23:10:363
2025699140,2cyclictest31812-21diskmemload22:33:043
2025699140,2cyclictest0-21swapper/323:46:243
2025699140,2cyclictest0-21swapper/322:26:553
2025699140,2cyclictest0-21swapper/322:08:443
2025699140,13cyclictest0-21swapper/323:50:153
2025699140,13cyclictest0-21swapper/322:14:253
2025699140,13cyclictest0-21swapper/321:25:453
2025699140,12cyclictest0-21swapper/300:35:143
2025699140,12cyclictest0-21swapper/300:00:163
20255991411,2cyclictest27376-21kworker/u8:123:14:042
20255991411,2cyclictest20223-21kworker/u8:022:52:052
20255991411,2cyclictest0-21swapper/222:55:382
2025599140,13cyclictest0-21swapper/220:20:182
2025599140,13cyclictest0-21swapper/220:20:172
20254991411,2cyclictest0-21swapper/122:58:221
2025499140,13cyclictest0-21swapper/119:50:121
20253991411,2cyclictest0-21swapper/023:16:360
20253991411,2cyclictest0-21swapper/020:30:150
20253991410,3cyclictest0-21swapper/020:45:180
2025399140,13cyclictest0-21swapper/023:57:560
2025399140,12cyclictest554-21pzem_power22:50:410
2025399140,12cyclictest0-21swapper/023:48:500
2025399140,12cyclictest0-21swapper/023:00:420
2025399140,12cyclictest0-21swapper/022:41:010
2025399140,12cyclictest0-21swapper/021:40:000
2025399140,12cyclictest0-21swapper/020:50:130
2025399140,12cyclictest0-21swapper/000:10:200
2025699139,2cyclictest19331-21ssh21:30:253
2025699139,2cyclictest0-21swapper/320:30:183
2025699138,3cyclictest28423-21fschecks_count21:00:153
20256991310,2cyclictest0-21swapper/323:56:553
20256991310,2cyclictest0-21swapper/323:35:553
20256991310,2cyclictest0-21swapper/323:25:353
20256991310,2cyclictest0-21swapper/322:55:183
20256991310,2cyclictest0-21swapper/321:55:123
20256991310,2cyclictest0-21swapper/320:45:153
20256991310,2cyclictest0-21swapper/300:30:153
20256991310,2cyclictest0-21swapper/300:16:063
2025699130,2cyclictest0-21swapper/323:00:563
2025699130,2cyclictest0-21swapper/300:25:173
2025699130,12cyclictest31812-21diskmemload23:05:263
2025699130,12cyclictest0-21swapper/323:18:153
2025699130,12cyclictest0-21swapper/320:11:033
2025599138,3cyclictest0-21swapper/219:50:122
20255991310,2cyclictest27213-21ssh00:25:182
20255991310,2cyclictest25215-21latency_hist22:10:002
20255991310,2cyclictest10355-21kworker/u8:022:04:052
20255991310,2cyclictest0-21swapper/222:35:082
20255991310,2cyclictest0-21swapper/220:26:032
20255991310,2cyclictest0-21swapper/220:01:032
20255991310,2cyclictest0-21swapper/200:01:272
2025599130,2cyclictest0-21swapper/221:05:132
2025599130,2cyclictest0-21swapper/219:55:162
2025599130,12cyclictest2205-21ssh00:33:372
2025599130,12cyclictest0-21swapper/223:05:382
2025599130,12cyclictest0-21swapper/221:43:372
2025599130,12cyclictest0-21swapper/221:30:072
2025599130,11cyclictest0-21swapper/221:21:432
2025499138,3cyclictest28332-21munin-node1
2025499138,3cyclictest0-21swapper/119:30:111
2025499132,6cyclictest0-21swapper/122:35:001
2025499131,3cyclictest0-21swapper/123:50:161
2025499131,3cyclictest0-21swapper/122:35:071
2025499131,3cyclictest0-21swapper/122:16:031
2025499131,10cyclictest3127-21nscd22:40:171
2025499131,10cyclictest0-21swapper/119:49:591
20254991310,2cyclictest0-21swapper/123:25:121
2025499130,2cyclictest31812-21diskmemload00:03:321
2025499130,2cyclictest0-21swapper/121:15:201
2025499130,2cyclictest0-21swapper/120:55:471
2025499130,12cyclictest0-21swapper/100:31:141
2025499130,12cyclictest0-21swapper/100:26:121
2025499130,11cyclictest0-21swapper/121:00:201
20253991310,2cyclictest0-21swapper/023:44:260
20253991310,2cyclictest0-21swapper/023:31:560
20253991310,2cyclictest0-21swapper/022:39:410
20253991310,2cyclictest0-21swapper/022:29:500
20253991310,2cyclictest0-21swapper/022:06:120
20253991310,2cyclictest0-21swapper/021:56:000
20253991310,2cyclictest0-21swapper/021:48:090
20253991310,2cyclictest0-21swapper/021:40:170
20253991310,2cyclictest0-21swapper/000:21:220
2025399130,2cyclictest5362-21kworker/u8:200:05:300
2025399130,2cyclictest21097-21runrttasks00:19:580
2025399130,2cyclictest0-21swapper/023:27:050
2025399130,2cyclictest0-21swapper/022:10:350
2025399130,2cyclictest0-21swapper/022:03:160
2025399130,2cyclictest0-21swapper/021:24:450
2025399130,2cyclictest0-21swapper/000:37:460
2025399130,12cyclictest31812-21diskmemload23:51:400
2025399130,12cyclictest0-21swapper/023:36:450
2025399130,12cyclictest0-21swapper/023:11:300
2025399130,12cyclictest0-21swapper/000:25:350
37692120,0sleep00-21swapper/022:20:210
263922120,2sleep231812-21diskmemload23:50:592
2025699129,2cyclictest8869-21ssh23:33:023
2025699129,2cyclictest0-21swapper/322:15:123
2025699129,2cyclictest0-21swapper/321:10:093
2025699122,5cyclictest0-21swapper/319:45:003
2025699120,11cyclictest0-21swapper/323:21:293
2025699120,11cyclictest0-21swapper/322:00:053
2025699120,11cyclictest0-21swapper/321:45:193
2025699120,11cyclictest0-21swapper/321:20:013
2025699120,11cyclictest0-21swapper/319:50:133
2025699120,11cyclictest0-21swapper/300:22:073
2025699120,11cyclictest0-21swapper/300:11:053
2025699120,10cyclictest0-21swapper/323:40:123
2025599129,2cyclictest22087-21ssh23:46:062
2025599129,2cyclictest13920-21ssh00:11:162
2025599129,2cyclictest0-21swapper/223:20:192
2025599129,2cyclictest0-21swapper/222:32:282
2025599129,2cyclictest0-21swapper/200:37:172
2025599129,2cyclictest0-21swapper/200:07:082
2025599128,3cyclictest23592-21fschecks_time19:20:092
2025599120,2cyclictest31812-21diskmemload21:19:492
2025599120,2cyclictest0-21swapper/223:30:272
2025599120,2cyclictest0-21swapper/219:45:172
2025599120,2cyclictest0-21swapper/219:25:072
2025599120,11cyclictest31812-21diskmemload21:14:172
2025599120,11cyclictest0-21swapper/223:58:282
2025599120,11cyclictest0-21swapper/223:25:192
2025599120,11cyclictest0-21swapper/222:29:592
2025599120,11cyclictest0-21swapper/222:23:482
2025599120,11cyclictest0-21swapper/222:10:192
2025599120,11cyclictest0-21swapper/221:00:202
2025599120,11cyclictest0-21swapper/219:30:572
2025599120,10cyclictest0-21swapper/223:36:222
2025499129,2cyclictest0-21swapper/123:55:531
2025499129,2cyclictest0-21swapper/123:40:501
2025499129,2cyclictest0-21swapper/121:35:151
2025499129,2cyclictest0-21swapper/121:22:371
2025499129,2cyclictest0-21swapper/121:05:121
2025499129,2cyclictest0-21swapper/100:37:541
2025499127,3cyclictest0-21swapper/120:30:181
2025499122,8cyclictest25947-21fschecks_time22:10:131
2025499121,9cyclictest23485-21munin-node1
2025499121,9cyclictest0-21swapper/120:50:141
2025499121,9cyclictest0-21swapper/120:25:131
2025499121,3cyclictest0-21swapper/121:50:131
2025499120,11cyclictest0-21swapper/123:45:241
2025499120,11cyclictest0-21swapper/120:35:141
2025499120,11cyclictest0-21swapper/119:20:081
2025499120,10cyclictest11461-21apt-get00:10:051
2025499120,10cyclictest0-21swapper/123:05:411
2025499120,10cyclictest0-21swapper/122:01:031
2025499120,10cyclictest0-21swapper/100:15:151
2025399129,2cyclictest0-21swapper/023:20:490
2025399129,2cyclictest0-21swapper/021:50:150
2025399129,2cyclictest0-21swapper/021:11:280
2025399129,2cyclictest0-21swapper/000:01:120
2025399120,2cyclictest0-21swapper/021:31:360
2025399120,11cyclictest0-21swapper/021:25:560
2025399120,11cyclictest0-21swapper/021:17:290
2025399120,11cyclictest0-21swapper/020:25:120
2025399120,11cyclictest0-21swapper/019:53:280
2025399120,11cyclictest0-21swapper/019:40:110
2025399120,11cyclictest0-21swapper/019:10:590
10472120,2sleep20-21swapper/222:18:072
2025699111,6cyclictest0-21swapper/319:34:593
2025699111,5cyclictest0-21swapper/320:10:013
2025699110,10cyclictest0-21swapper/319:26:573
2025599118,2cyclictest16048-21kworker/u8:220:38:052
2025599118,2cyclictest0-21swapper/221:26:042
2025599118,2cyclictest0-21swapper/220:51:032
2025599118,2cyclictest0-21swapper/220:05:162
2025599118,2cyclictest0-21swapper/200:18:572
2025599110,2cyclictest0-21swapper/223:40:322
2025599110,2cyclictest0-21swapper/221:39:592
2025599110,10cyclictest0-21swapper/222:40:442
2025499117,2cyclictest12295-21diskstats20:20:141
2025499117,2cyclictest12295-21diskstats20:20:141
2025499116,3cyclictest26898-21munin-node1
2025499116,3cyclictest0-21swapper/119:20:001
2025499111,8cyclictest8258-21diskstats20:10:121
2025499111,8cyclictest7582-21apt-get22:25:101
2025499111,8cyclictest24884-21apt-get19:25:061
2025499111,3cyclictest0-21swapper/120:05:201
2025499111,3cyclictest0-21swapper/119:10:151
2025499111,2cyclictest0-21swapper/120:00:141
2025499110,9cyclictest29645-21ls21:40:171
2025499110,9cyclictest0-21swapper/120:40:121
2025499110,3cyclictest22450-21fschecks_time20:45:161
2025399118,2cyclictest0-21swapper/020:55:110
2025399118,2cyclictest0-21swapper/020:20:400
2025399118,2cyclictest0-21swapper/020:20:390
2025399110,10cyclictest24792-21kworker/u8:119:26:040
2025399110,10cyclictest0-21swapper/020:15:160
2025399110,10cyclictest0-21swapper/019:16:280
2025599108,1cyclictest0-21swapper/220:16:042
2025599107,2cyclictest8951-21kworker/u8:220:11:032
2025599107,2cyclictest17990-21kworker/u8:119:16:012
2025599107,2cyclictest0-21swapper/223:00:432
2025399107,2cyclictest30795-21memory21:05:180
2025399107,2cyclictest0-21swapper/019:57:280
2025399100,9cyclictest0-21swapper/019:35:580
148332100,2sleep30-21swapper/320:25:193
202569994,3cyclictest4482-21interrupts20:00:163
202569994,3cyclictest3728-21runrttasks20:35:233
202569994,3cyclictest3728-21runrttasks19:55:233
202569994,3cyclictest3728-21runrttasks19:17:443
202569994,3cyclictest3649-21snmpd20:20:133
202569994,3cyclictest3649-21snmpd20:20:123
202569994,3cyclictest30172-21aten2.4_r3power21:05:133
202569994,3cyclictest26676-21kernelversion20:55:143
202569994,3cyclictest24011-21open_inodes19:20:143
202569990,2cyclictest0-21swapper/319:36:153
202559994,3cyclictest3728-21runrttasks19:35:162
202559994,3cyclictest28735-21sed19:40:142
202559994,3cyclictest26042-21head20:55:102
202559994,3cyclictest20811-21df_abs19:10:122
202559994,3cyclictest16208-21tr20:30:132
202559991,3cyclictest20572-21grep20:40:152
202549991,3cyclictest28144-21sendmail-msp19:40:001
202539996,2cyclictest0-21swapper/019:23:280
202539994,4cyclictest0-21swapper/021:04:050
202539990,8cyclictest16048-21kworker/u8:220:43:040
5394280,1sleep00-21swapper/020:01:590
202569984,2cyclictest0-21swapper/320:50:123
202569983,3cyclictest9997-21head20:15:133
202569980,7cyclictest0-21swapper/320:40:243
202569980,7cyclictest0-21swapper/319:45:013
202559983,3cyclictest22132-21cpu20:45:142
202539983,4cyclictest0-21swapper/019:30:090
202539980,2cyclictest0-21swapper/020:36:260
202539980,2cyclictest0-21swapper/019:45:370
202539973,3cyclictest7863-21munin-node0
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional