You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-30 - 10:07

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack3slot6s.osadl.org (updated Sat May 30, 2026 00:43:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
152232122111,6sleep30-21swapper/319:06:423
153582114104,6sleep20-21swapper/219:08:252
15215211187,19sleep00-21swapper/019:06:350
15199211093,12sleep10-21swapper/119:06:241
2837721050,1sleep228373-21hddtemp_smartct19:40:132
325942810,1sleep00-21swapper/022:50:180
246742780,1sleep031569-21diskmemload21:35:180
210902760,1sleep20-21swapper/222:39:182
14362740,0sleep10-21swapper/121:11:071
89842320,1sleep20-21swapper/220:11:022
1550899279,16cyclictest0-21swapper/219:15:102
1550999231,20cyclictest3982-21ssh22:55:103
163992220,0sleep00-21swapper/023:40:280
1550699220,20cyclictest0-21swapper/021:00:110
1550699220,20cyclictest0-21swapper/019:55:110
1550699210,19cyclictest0-21swapper/021:05:110
15508992017,2cyclictest8683-21kworker/u8:119:21:042
178662190,0sleep20-21swapper/221:28:552
1550999191,2cyclictest0-21swapper/321:40:113
15508991815,2cyclictest5157-21kworker/u8:220:36:042
15508991815,2cyclictest25837-21kworker/u8:021:08:052
15508991815,2cyclictest25348-21kworker/u8:122:46:042
15508991815,2cyclictest0-21swapper/220:05:122
1550899180,4cyclictest0-21swapper/200:04:042
62932170,0sleep20-21swapper/222:56:252
15508991714,2cyclictest8665-21kworker/u8:223:38:042
15508991714,2cyclictest7874-21kworker/u8:222:04:012
15508991714,2cyclictest7682-21kworker/u8:020:18:022
15508991714,2cyclictest6558-21kworker/u8:023:02:042
15508991714,2cyclictest5157-21kworker/u8:220:30:042
15508991714,2cyclictest25837-21kworker/u8:021:02:042
15508991714,2cyclictest23722-21kworker/u8:200:35:042
15508991714,2cyclictest21717-21kworker/u8:221:20:052
15508991714,2cyclictest21717-21kworker/u8:221:10:012
15508991714,2cyclictest20916-21kworker/u8:021:50:022
15508991714,2cyclictest19948-21kworker/u8:122:10:042
15508991714,2cyclictest18656-21kworker/u8:023:31:042
15508991714,2cyclictest14431-21kworker/u8:022:16:052
15508991714,2cyclictest12188-21kworker/u8:223:13:042
1550899171,2cyclictest31569-21diskmemload21:15:042
1550899170,4cyclictest0-21swapper/220:02:042
1550899170,12cyclictest0-21swapper/219:11:042
1550999161,13cyclictest0-21swapper/319:15:143
1550999161,13cyclictest0-21swapper/319:10:163
1550999160,14cyclictest0-21swapper/300:16:163
15508991613,2cyclictest653-21kworker/u8:123:47:042
15508991613,2cyclictest653-21kworker/u8:123:28:042
15508991613,2cyclictest31946-21kworker/u8:019:55:042
15508991613,2cyclictest313-21kworker/u8:122:24:042
15508991613,2cyclictest25291-21kworker/u8:222:32:042
15508991613,2cyclictest23722-21kworker/u8:200:25:042
15508991613,2cyclictest22797-21kworker/u8:019:33:042
15508991613,2cyclictest20916-21kworker/u8:021:36:012
15508991613,2cyclictest17157-21kworker/u8:020:41:052
1550899161,2cyclictest0-21swapper/200:20:052
15508991611,3cyclictest15259-21apt-get22:00:002
1550799161,3cyclictest0-21swapper/122:45:111
15509991510,3cyclictest0-21swapper/320:45:183
1550999150,13cyclictest0-21swapper/323:52:373
15508991512,2cyclictest32225-21kworker/u8:121:45:042
15508991512,2cyclictest21717-21kworker/u8:220:48:042
15508991512,2cyclictest19214-21kworker/u8:120:52:042
15508991512,2cyclictest17142-21kworker/u8:022:41:052
15508991512,2cyclictest11686-21kworker/u8:100:14:042
1550899150,11cyclictest0-21swapper/219:54:052
1550799151,3cyclictest20151-21diskstats19:20:121
1550799151,12cyclictest31766-21cpuspeed_turbos22:50:121
303092140,3sleep00-21swapper/022:48:350
1550999149,3cyclictest1381-21taskset00:32:213
1550999143,7cyclictest0-21swapper/320:21:003
15509991411,2cyclictest381ktimersoftd/300:04:063
1550999141,11cyclictest381ktimersoftd/322:00:123
1550999141,11cyclictest381ktimersoftd/321:15:293
15509991410,2cyclictest0-21swapper/321:32:163
15509991410,2cyclictest0-21swapper/321:32:163
1550999140,3cyclictest27080-21rm21:38:163
1550999140,3cyclictest16210-21munin-node3
15508991411,2cyclictest7305-21kworker/u8:022:25:052
15508991411,2cyclictest29193-21kworker/u8:000:30:052
15508991411,2cyclictest25348-21kworker/u8:123:06:052
15508991410,2cyclictest0-21swapper/223:40:572
1550899140,3cyclictest0-21swapper/220:59:042
1550899140,2cyclictest0-21swapper/222:51:022
1550899140,12cyclictest0-21swapper/223:58:342
1550899140,12cyclictest0-21swapper/223:53:152
1550899140,12cyclictest0-21swapper/219:35:182
1550799142,6cyclictest0-21swapper/120:35:011
1550799141,11cyclictest31569-21diskmemload22:41:231
1550799140,12cyclictest0-21swapper/121:50:001
1550799140,12cyclictest0-21swapper/120:45:191
1550699149,3cyclictest0-21swapper/023:58:510
15506991411,2cyclictest0-21swapper/021:44:490
15506991411,2cyclictest0-21swapper/000:26:580
1550699140,3cyclictest12297-21tune2fs00:10:160
1550699140,2cyclictest0-21swapper/022:35:080
1550699140,2cyclictest0-21swapper/021:55:180
1550699140,13cyclictest0-21swapper/022:09:290
1550699140,12cyclictest0-21swapper/021:30:320
1550699140,12cyclictest0-21swapper/021:30:320
1550699140,12cyclictest0-21swapper/000:39:210
312202130,2sleep20-21swapper/223:22:402
251272130,2sleep10-21swapper/100:23:471
155532131,2sleep115259-21apt-get22:00:061
1550999139,2cyclictest24450-21pzem_current23:15:173
1550999139,2cyclictest0-21swapper/320:41:013
1550999131,3cyclictest8981-21ssh23:33:183
1550999131,11cyclictest0-21swapper/323:38:363
15509991310,2cyclictest39-21ksoftirqd/322:18:453
15509991310,2cyclictest39-21ksoftirqd/319:20:093
15509991310,2cyclictest381ktimersoftd/322:46:443
15509991310,2cyclictest31569-21diskmemload23:11:063
15509991310,2cyclictest31569-21diskmemload22:34:473
15509991310,2cyclictest0-21swapper/322:35:163
15509991310,2cyclictest0-21swapper/322:10:173
15509991310,2cyclictest0-21swapper/320:11:003
1550999130,12cyclictest381ktimersoftd/322:29:373
1550999130,12cyclictest381ktimersoftd/321:45:143
1550999130,12cyclictest381ktimersoftd/321:10:153
1550999130,11cyclictest29345-21sshd23:20:223
1550999130,11cyclictest0-21swapper/323:57:313
1550999130,11cyclictest0-21swapper/321:25:063
15508991310,2cyclictest0-21swapper/221:34:482
15508991310,2cyclictest0-21swapper/221:34:472
1550899130,2cyclictest0-21swapper/223:16:252
1550899130,2cyclictest0-21swapper/221:44:042
1550899130,2cyclictest0-21swapper/220:22:012
1550899130,12cyclictest0-21swapper/200:05:162
1550899130,11cyclictest16503-21ssh00:15:032
1550799139,2cyclictest7968-21ssh00:39:511
1550799139,2cyclictest29855-21python23:21:001
1550799138,3cyclictest0-21swapper/122:15:121
1550799132,6cyclictest0-21swapper/120:30:001
1550799132,6cyclictest0-21swapper/119:55:001
1550799131,6cyclictest0-21swapper/120:10:001
1550799131,4cyclictest23950-21ls21:35:141
1550799131,3cyclictest0-21swapper/122:36:031
15507991310,2cyclictest31569-21diskmemload00:31:111
15507991310,2cyclictest0-21swapper/122:10:501
15507991310,2cyclictest0-21swapper/100:16:011
1550799130,2cyclictest0-21swapper/119:50:131
1550799130,11cyclictest31660-21ssh23:56:091
1550699131,7cyclictest0-21swapper/023:15:000
15506991310,2cyclictest0-21swapper/023:15:210
15506991310,2cyclictest0-21swapper/023:08:390
15506991310,2cyclictest0-21swapper/022:30:590
15506991310,2cyclictest0-21swapper/022:11:190
15506991310,2cyclictest0-21swapper/021:12:180
15506991310,2cyclictest0-21swapper/020:55:190
1550699130,2cyclictest0-21swapper/022:22:380
1550699130,2cyclictest0-21swapper/021:25:120
1550699130,12cyclictest0-21swapper/023:50:080
1550699130,12cyclictest0-21swapper/023:30:290
1550699130,12cyclictest0-21swapper/023:26:030
1550699130,12cyclictest0-21swapper/022:40:150
1550699130,12cyclictest0-21swapper/022:18:080
1550699130,12cyclictest0-21swapper/021:50:080
1550699130,12cyclictest0-21swapper/000:23:590
1550699130,11cyclictest0-21swapper/021:46:410
1550999129,2cyclictest24506-21ssh22:42:023
1550999129,2cyclictest0-21swapper/323:46:253
1550999129,2cyclictest0-21swapper/320:00:153
1550999122,7cyclictest0-21swapper/300:26:583
1550999121,1cyclictest0-21swapper/300:08:143
1550999120,2cyclictest31569-21diskmemload22:21:403
1550999120,2cyclictest0-21swapper/320:50:153
1550999120,11cyclictest381ktimersoftd/323:05:253
1550999120,11cyclictest0-21swapper/323:25:183
1550999120,11cyclictest0-21swapper/323:03:413
1550999120,11cyclictest0-21swapper/322:05:153
1550999120,11cyclictest0-21swapper/321:50:183
1550999120,11cyclictest0-21swapper/321:21:063
1550999120,11cyclictest0-21swapper/320:25:193
1550999120,11cyclictest0-21swapper/300:37:213
1550899129,2cyclictest0-21swapper/222:05:462
1550899129,2cyclictest0-21swapper/219:46:042
1550799129,2cyclictest31569-21diskmemload21:55:491
1550799129,2cyclictest0-21swapper/119:11:011
1550799127,3cyclictest9475-21tune2fs23:00:131
1550799123,5cyclictest0-21swapper/123:11:001
1550799122,5cyclictest0-21swapper/120:55:001
1550799122,5cyclictest0-21swapper/120:05:001
1550799121,9cyclictest4380-21munin-node1
1550799121,9cyclictest0-21swapper/121:01:021
1550799121,9cyclictest0-21swapper/120:40:301
1550799121,6cyclictest31650-21copy19:50:001
1550799121,6cyclictest0-21swapper/123:45:001
1550799121,3cyclictest0-21swapper/122:55:121
1550799121,3cyclictest0-21swapper/122:30:121
1550799121,3cyclictest0-21swapper/119:30:161
1550799121,3cyclictest0-21swapper/100:11:051
1550799120,2cyclictest0-21swapper/122:08:301
1550799120,2cyclictest0-21swapper/121:28:301
1550799120,11cyclictest0-21swapper/123:51:011
1550799120,11cyclictest0-21swapper/121:51:031
1550799120,11cyclictest0-21swapper/100:25:201
1550799120,10cyclictest0-21swapper/121:33:001
1550799120,10cyclictest0-21swapper/121:32:591
1550699129,2cyclictest17818-21ssh00:15:320
1550699129,2cyclictest0-21swapper/023:46:130
1550699129,2cyclictest0-21swapper/019:15:390
1550699129,2cyclictest0-21swapper/000:05:100
1550699129,2cyclictest0-21swapper/000:01:050
1550699122,6cyclictest0-21swapper/021:16:010
1550699120,2cyclictest0-21swapper/023:00:010
1550699120,2cyclictest0-21swapper/022:55:150
1550699120,2cyclictest0-21swapper/022:00:540
1550699120,2cyclictest0-21swapper/020:36:500
1550699120,11cyclictest0-21swapper/023:37:030
1550699120,11cyclictest0-21swapper/023:22:130
1550699120,11cyclictest0-21swapper/022:25:450
1550699120,11cyclictest0-21swapper/021:21:440
1550699120,11cyclictest0-21swapper/020:50:150
1550699120,11cyclictest0-21swapper/019:21:010
1550699120,11cyclictest0-21swapper/019:10:140
1550699120,11cyclictest0-21swapper/000:30:520
65062110,0sleep10-21swapper/100:04:461
1550999118,2cyclictest0-21swapper/321:00:123
1550999118,2cyclictest0-21swapper/319:50:123
1550999118,2cyclictest0-21swapper/300:20:113
1550999116,3cyclictest30190-21cut21:05:143
1550999116,3cyclictest26221-21cut20:55:133
1550999111,2cyclictest381ktimersoftd/300:10:543
1550999110,3cyclictest27578-21tr19:40:003
1550999110,2cyclictest381ktimersoftd/321:57:173
1550999110,10cyclictest31569-21diskmemload22:50:443
1550899118,2cyclictest0-21swapper/220:25:162
1550799118,2cyclictest0-21swapper/123:31:031
1550799118,2cyclictest0-21swapper/120:05:151
1550799117,2cyclictest0-21swapper/119:35:161
1550799116,3cyclictest25907-21wc20:55:121
1550799116,3cyclictest0-21swapper/123:05:161
1550799111,8cyclictest0-21swapper/123:35:111
1550799111,8cyclictest0-21swapper/100:05:181
1550799111,3cyclictest9953-21irqstats21:20:161
1550799111,3cyclictest23415-21aten2.4_r3power23:15:091
1550799111,3cyclictest0-21swapper/120:20:151
1550799110,9cyclictest21765-21munin-node1
1550799110,9cyclictest0-21swapper/121:40:131
1550799110,9cyclictest0-21swapper/120:35:121
1550799110,9cyclictest0-21swapper/120:15:161
1550799110,9cyclictest0-21swapper/119:45:011
1550799110,2cyclictest0-21swapper/123:29:311
1550799110,2cyclictest0-21swapper/122:25:381
1550799110,2cyclictest0-21swapper/122:20:401
1550699118,2cyclictest0-21swapper/020:40:160
1550699118,2cyclictest0-21swapper/019:50:020
1550699118,2cyclictest0-21swapper/019:45:180
1550699118,2cyclictest0-21swapper/019:35:500
1550699111,5cyclictest0-21swapper/020:30:010
1550999107,2cyclictest0-21swapper/319:40:133
1550999101,7cyclictest0-21swapper/320:16:593
1550999101,6cyclictest0-21swapper/320:31:003
1550999101,5cyclictest0-21swapper/319:56:003
1550799106,2cyclictest0-21swapper/121:05:171
1550799101,3cyclictest20654-21hostname23:45:141
1550699105,3cyclictest5870-21cut20:05:150
1550699101,5cyclictest0-21swapper/020:15:000
1550699101,5cyclictest0-21swapper/019:40:010
1550699100,9cyclictest0-21swapper/020:19:580
155099994,3cyclictest381ktimersoftd/320:05:133
155099994,3cyclictest24624-21tail19:30:163
155099994,3cyclictest22613-21needreboot19:25:163
155099992,6cyclictest0-21swapper/320:36:013
155099991,7cyclictest39-21ksoftirqd/319:49:253
155089994,3cyclictest3728-21runrttasks19:26:202
155079990,2cyclictest0-21swapper/119:15:111
155069996,2cyclictest0-21swapper/020:20:540
155069994,3cyclictest14993-21timerwakeupswit20:26:020
155069992,6cyclictest0-21swapper/019:25:490
155069990,8cyclictest0-21swapper/020:46:100
155069983,3cyclictest4304-21wc20:00:140
155069973,2cyclictest24021-21cpuspeed_turbos19:30:120
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional