You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-18 - 20:54

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack3slot6s.osadl.org (updated Wed Mar 18, 2026 12:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
121512117106,6sleep00-21swapper/007:08:510
12087211694,16sleep30-21swapper/307:08:023
115242115105,6sleep10-21swapper/107:05:511
11530210897,6sleep20-21swapper/207:05:562
77142850,3sleep01226999cyclictest08:16:000
77142850,3sleep01226999cyclictest08:16:000
81632750,1sleep00-21swapper/010:28:340
47382720,0sleep10-21swapper/108:10:121
311402510,1sleep331139-21ssh11:59:393
12270993918,19cyclictest207150irq/24-eth108:30:101
12275993517,16cyclictest23487-21ssh12:25:103
243302280,1sleep2301ktimersoftd/212:25:152
104432280,0sleep00-21swapper/012:10:500
1227599250,2cyclictest0-21swapper/309:20:123
45792220,1sleep011-21rcuc/011:31:020
252122220,0sleep10-21swapper/109:39:481
197512220,1sleep10-21swapper/111:46:541
197512220,1sleep10-21swapper/111:46:541
1227099228,13cyclictest0-21swapper/112:25:111
1227099220,20cyclictest0-21swapper/112:20:111
282262210,1sleep09-21ksoftirqd/010:49:460
254952210,0sleep1221ktimersoftd/107:40:161
12275992117,2cyclictest0-21swapper/311:05:103
1227599210,19cyclictest0-21swapper/309:45:123
326462200,1sleep20-21swapper/211:26:472
313432200,1sleep10-21swapper/112:32:401
1227099200,2cyclictest0-21swapper/110:10:121
1227599191,16cyclictest0-21swapper/311:40:123
1227599190,2cyclictest0-21swapper/308:30:103
1227299190,2cyclictest0-21swapper/208:30:112
1227099190,17cyclictest0-21swapper/109:45:121
12269991916,2cyclictest26778-21kworker/u8:012:19:040
1227599180,2cyclictest0-21swapper/308:15:113
1227599180,2cyclictest0-21swapper/308:15:113
12270991815,2cyclictest0-21swapper/111:05:101
12269991815,2cyclictest27177-21kworker/u8:111:04:040
12269991815,2cyclictest25834-21kworker/u8:212:34:040
12269991815,2cyclictest21011-21kworker/u8:009:42:050
12269991815,2cyclictest18210-21kworker/u8:111:27:040
12275991714,2cyclictest7145-21kworker/u8:212:15:043
12269991714,2cyclictest7681-21kworker/u8:111:41:040
12269991714,2cyclictest27177-21kworker/u8:110:39:040
12269991714,2cyclictest27177-21kworker/u8:110:32:050
12269991714,2cyclictest14516-21kworker/u8:107:54:040
69602160,0sleep06961-21smartctl09:20:150
1227599162,3cyclictest21913-21sh11:15:453
1227599161,3cyclictest0-21swapper/310:43:543
1227599161,13cyclictest0-21swapper/308:55:063
12275991611,3cyclictest0-21swapper/308:35:123
1227599160,14cyclictest0-21swapper/312:20:113
12272991613,2cyclictest30957-21kworker/u8:210:52:042
12272991613,2cyclictest3089-21kworker/u8:109:53:042
12269991613,2cyclictest28882-21kworker/u8:109:16:010
12269991613,2cyclictest13188-21kworker/u8:109:35:050
12275991512,2cyclictest0-21swapper/309:39:023
1227599151,12cyclictest11054-21ssh09:58:023
12275991510,3cyclictest3351-21diskstats09:50:133
1227599150,13cyclictest0-21swapper/307:59:563
12272991512,2cyclictest0-21swapper/210:29:462
12272991511,2cyclictest0-21swapper/211:34:362
1227299150,13cyclictest18655-21munin-node2
1227299150,13cyclictest14880-21ssh10:01:262
1227099151,3cyclictest0-21swapper/112:10:161
12270991512,2cyclictest28620-21diskmemload09:51:091
1227099151,12cyclictest6689-21hddtemp_smartct11:00:141
12269991512,2cyclictest8391-21kworker/u8:108:49:040
12269991512,2cyclictest445-21kworker/u8:008:07:040
12269991512,2cyclictest27177-21kworker/u8:110:55:040
12269991512,2cyclictest26778-21kworker/u8:012:25:040
12269991512,2cyclictest2091-21kworker/u8:112:36:040
12269991512,2cyclictest0-21swapper/012:08:340
1226999150,2cyclictest6320-21ssh09:53:040
1226999150,2cyclictest0-21swapper/009:46:340
1226999150,13cyclictest0-21swapper/011:55:040
1226999150,13cyclictest0-21swapper/010:10:040
1227599149,3cyclictest0-21swapper/311:25:123
1227599140,2cyclictest0-21swapper/308:20:123
1227599140,12cyclictest18741-21munin-node3
1227599140,12cyclictest0-21swapper/312:07:583
1227599140,12cyclictest0-21swapper/310:55:133
1227599140,12cyclictest0-21swapper/310:00:083
1227599140,12cyclictest0-21swapper/309:31:373
1227599140,12cyclictest0-21swapper/307:30:173
12272991411,2cyclictest26778-21kworker/u8:011:55:042
12272991411,2cyclictest0-21swapper/212:01:162
12272991411,2cyclictest0-21swapper/211:54:362
12272991411,2cyclictest0-21swapper/210:57:462
12272991411,2cyclictest0-21swapper/210:44:062
12272991411,2cyclictest0-21swapper/209:56:362
12272991411,2cyclictest0-21swapper/209:37:162
1227299140,3cyclictest1364-21proc_pri08:00:182
1227299140,2cyclictest4027-21ssh09:17:062
1227299140,2cyclictest0-21swapper/209:30:162
1227299140,2cyclictest0-21swapper/209:00:152
1227299140,13cyclictest0-21swapper/211:22:562
1227299140,13cyclictest0-21swapper/210:17:462
1227299140,12cyclictest0-21swapper/212:15:122
1227299140,12cyclictest0-21swapper/211:36:022
1227299140,12cyclictest0-21swapper/211:15:122
1227099149,3cyclictest23890-21aten2.4_r3power10:45:111
12270991411,2cyclictest0-21swapper/109:57:591
12270991410,2cyclictest0-21swapper/111:43:301
1227099140,2cyclictest0-21swapper/110:18:091
1227099140,2cyclictest0-21swapper/109:20:121
1227099140,13cyclictest0-21swapper/111:50:591
1227099140,13cyclictest0-21swapper/109:15:291
1227099140,12cyclictest22547-21apt-get08:55:071
12269991411,2cyclictest8391-21kworker/u8:108:36:050
12269991411,2cyclictest445-21kworker/u8:008:02:020
12269991411,2cyclictest30957-21kworker/u8:211:10:040
12269991411,2cyclictest14516-21kworker/u8:107:24:040
12269991411,2cyclictest13188-21kworker/u8:109:28:040
1226999140,2cyclictest0-21swapper/011:39:140
1226999140,13cyclictest0-21swapper/011:09:440
1226999140,12cyclictest12667-21apt-get10:00:120
1226999140,12cyclictest0-21swapper/009:11:440
73102130,2sleep128620-21diskmemload12:07:481
1227599132,8cyclictest0-21swapper/307:20:003
1227599132,7cyclictest0-21swapper/309:10:013
1227599131,10cyclictest0-21swapper/310:46:383
12275991310,2cyclictest28620-21diskmemload09:40:343
12275991310,2cyclictest23877-21ssh10:10:553
12275991310,2cyclictest0-21swapper/311:35:173
12275991310,2cyclictest0-21swapper/311:20:153
12275991310,2cyclictest0-21swapper/311:00:413
12275991310,2cyclictest0-21swapper/310:50:043
12275991310,2cyclictest0-21swapper/310:38:153
12275991310,2cyclictest0-21swapper/310:30:263
12275991310,2cyclictest0-21swapper/310:05:323
12275991310,2cyclictest0-21swapper/309:19:223
12275991310,2cyclictest0-21swapper/308:40:143
12275991310,2cyclictest0-21swapper/307:10:123
1227599130,2cyclictest0-21swapper/311:50:423
1227599130,2cyclictest0-21swapper/311:45:303
1227599130,2cyclictest0-21swapper/311:45:303
1227599130,12cyclictest0-21swapper/312:36:233
1227599130,12cyclictest0-21swapper/312:30:023
1227599130,12cyclictest0-21swapper/312:02:443
1227599130,12cyclictest0-21swapper/311:10:163
1227599130,12cyclictest0-21swapper/309:28:253
1227599130,11cyclictest10084-21ssh12:10:203
12272991310,2cyclictest20989-21kworker/u8:310:10:042
12272991310,2cyclictest15909-21kworker/u8:110:08:042
12272991310,2cyclictest14516-21kworker/u8:107:52:042
12272991310,2cyclictest0-21swapper/212:37:462
12272991310,2cyclictest0-21swapper/212:05:112
12272991310,2cyclictest0-21swapper/211:45:262
12272991310,2cyclictest0-21swapper/211:45:262
12272991310,2cyclictest0-21swapper/211:41:062
12272991310,2cyclictest0-21swapper/210:39:532
12272991310,2cyclictest0-21swapper/210:32:062
12272991310,2cyclictest0-21swapper/210:20:152
12272991310,2cyclictest0-21swapper/209:22:182
12272991310,2cyclictest0-21swapper/209:11:072
1227299130,2cyclictest0-21swapper/209:44:462
1227299130,12cyclictest0-21swapper/212:13:082
1227299130,12cyclictest0-21swapper/211:10:162
1227299130,12cyclictest0-21swapper/211:08:582
1227299130,12cyclictest0-21swapper/210:45:072
1227299130,12cyclictest0-21swapper/209:26:372
12270991310,2cyclictest0-21swapper/112:15:391
12270991310,2cyclictest0-21swapper/111:57:191
12270991310,2cyclictest0-21swapper/111:26:201
12270991310,2cyclictest0-21swapper/111:10:131
12270991310,2cyclictest0-21swapper/110:54:011
12270991310,2cyclictest0-21swapper/110:05:401
12270991310,2cyclictest0-21swapper/110:00:111
12270991310,2cyclictest0-21swapper/109:44:291
1227099130,2cyclictest0-21swapper/111:35:171
1227099130,2cyclictest0-21swapper/108:21:011
1227099130,12cyclictest0-21swapper/112:35:421
1227099130,12cyclictest0-21swapper/110:43:191
1227099130,12cyclictest0-21swapper/109:25:491
1226999131,10cyclictest0-21swapper/010:16:120
12269991310,2cyclictest445-21kworker/u8:008:10:040
12269991310,2cyclictest14516-21kworker/u8:107:28:040
12269991310,2cyclictest0-21swapper/009:30:130
12269991310,2cyclictest0-21swapper/007:30:180
1226999130,3cyclictest3649-21snmpd08:33:190
1226999130,2cyclictest28620-21diskmemload11:51:130
1226999130,2cyclictest28620-21diskmemload09:58:330
1226999130,2cyclictest0-21swapper/010:54:040
1226999130,2cyclictest0-21swapper/010:24:030
1226999130,2cyclictest0-21swapper/008:55:120
1226999130,12cyclictest28620-21diskmemload12:22:140
256222120,8sleep00-21swapper/011:20:130
218382120,2sleep20-21swapper/208:51:012
1227599129,2cyclictest0-21swapper/310:23:283
1227599129,2cyclictest0-21swapper/309:10:023
1227599129,2cyclictest0-21swapper/308:50:123
1227599122,7cyclictest0-21swapper/307:50:013
1227599120,2cyclictest0-21swapper/310:25:163
1227599120,2cyclictest0-21swapper/307:25:133
1227599120,11cyclictest0-21swapper/311:34:213
1227599120,11cyclictest0-21swapper/310:16:543
1227599120,11cyclictest0-21swapper/308:26:043
1227599120,11cyclictest0-21swapper/308:10:133
1227599120,11cyclictest0-21swapper/307:45:183
1227299129,2cyclictest8391-21kworker/u8:108:37:042
1227299129,2cyclictest31132-21kworker/2:108:10:142
1227299129,2cyclictest30957-21kworker/u8:211:03:042
1227299129,2cyclictest14516-21kworker/u8:107:18:042
1227299129,2cyclictest0-21swapper/212:30:262
1227299129,2cyclictest0-21swapper/207:31:002
1227299129,2cyclictest0-21swapper/207:21:032
1227299120,2cyclictest0-21swapper/207:35:372
1227299120,11cyclictest0-21swapper/209:45:292
1227099129,2cyclictest0-21swapper/110:56:191
1227099129,2cyclictest0-21swapper/107:50:001
1227099128,2cyclictest0-21swapper/108:50:161
1227099128,2cyclictest0-21swapper/108:45:161
1227099128,2cyclictest0-21swapper/108:00:141
1227099121,9cyclictest0-21swapper/107:45:141
1227099121,9cyclictest0-21swapper/107:20:131
1227099121,3cyclictest25214-21diskstats09:00:131
1227099120,2cyclictest28620-21diskmemload10:35:211
1227099120,2cyclictest0-21swapper/112:00:131
1227099120,2cyclictest0-21swapper/111:20:311
1227099120,2cyclictest0-21swapper/111:15:171
1227099120,2cyclictest0-21swapper/110:31:511
1227099120,2cyclictest0-21swapper/109:31:111
1227099120,11cyclictest0-21swapper/111:30:501
1227099120,11cyclictest0-21swapper/110:25:501
1227099120,11cyclictest0-21swapper/110:20:111
1227099120,11cyclictest0-21swapper/109:11:301
1227099120,11cyclictest0-21swapper/108:40:131
1227099120,11cyclictest0-21swapper/108:35:381
1227099120,11cyclictest0-21swapper/108:25:121
1227099120,11cyclictest0-21swapper/107:59:431
1226999129,2cyclictest27462-21kworker/u8:207:14:050
1226999129,2cyclictest0-21swapper/012:03:430
1226999129,2cyclictest0-21swapper/010:40:000
1226999129,2cyclictest0-21swapper/008:40:140
1226999121,9cyclictest0-21swapper/007:45:000
1226999120,11cyclictest0-21swapper/011:17:130
1226999120,10cyclictest0-21swapper/011:46:040
1226999120,10cyclictest0-21swapper/011:46:040
161142110,2sleep00-21swapper/007:17:320
1227599118,2cyclictest0-21swapper/307:35:143
1227599116,3cyclictest25424-21grep09:00:143
1227599116,3cyclictest25081-21grep07:40:133
1227299118,2cyclictest445-21kworker/u8:008:19:042
1227299118,2cyclictest445-21kworker/u8:008:19:042
1227299118,2cyclictest22891-21kworker/u8:208:58:062
1227299110,2cyclictest0-21swapper/207:45:142
1227099118,2cyclictest0-21swapper/107:15:511
1227099112,7cyclictest0-21swapper/109:05:011
1227099110,9cyclictest22556-21kworker/1:207:25:131
1227099110,2cyclictest0-21swapper/107:32:321
1226999118,2cyclictest24829-21kworker/u8:207:46:050
1226999118,2cyclictest18874-21kworker/u8:009:06:040
1226999118,2cyclictest0-21swapper/008:20:100
1226999110,2cyclictest0-21swapper/010:05:280
139892100,2sleep20-21swapper/207:11:052
1227599105,3cyclictest4466-21sed08:10:003
1227599105,3cyclictest16871-21df_abs07:20:133
1227299107,2cyclictest8391-21kworker/u8:108:45:042
1227299107,2cyclictest14516-21kworker/u8:107:59:042
1227299107,2cyclictest0-21swapper/208:05:112
1227299100,2cyclictest0-21swapper/207:40:142
1227099107,2cyclictest0-21swapper/107:10:011
1227099100,7cyclictest4562-21gdm-simple-gree08:07:581
1227099100,2cyclictest0-21swapper/108:15:121
1227099100,2cyclictest0-21swapper/108:15:121
1226999107,2cyclictest8391-21kworker/u8:108:50:050
1226999106,3cyclictest25458-21ethtool09:00:140
122759994,3cyclictest540-21aten2.4_r3power08:00:123
122729996,2cyclictest10749-21kworker/u8:008:28:042
122729994,3cyclictest19808-21grep07:26:022
122729994,3cyclictest18686-21cat08:45:002
122709990,2cyclictest0-21swapper/107:35:091
122699995,3cyclictest23359-21ls07:35:150
122699990,8cyclictest0-21swapper/008:25:150
122699990,2cyclictest0-21swapper/007:59:040
122729985,2cyclictest8797-21aten2.4-expect08:20:112
122729970,6cyclictest0-21swapper/209:05:062
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional