You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-23 - 09:27

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack3slot6s.osadl.org (updated Thu Jul 23, 2026 00:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
18043210683,18sleep20-21swapper/219:07:402
17945210687,12sleep30-21swapper/319:06:263
18010210584,16sleep10-21swapper/119:07:151
17954210585,15sleep00-21swapper/019:06:300
100912800,0sleep30-21swapper/322:25:003
59342750,0sleep10-21swapper/122:55:511
124932720,0sleep30-21swapper/323:03:193
1825599340,32cyclictest0-21swapper/322:45:133
114112290,1sleep10-21swapper/121:19:591
289352270,2sleep123-21ksoftirqd/123:53:321
318762260,1sleep20-21swapper/222:13:522
129432260,1sleep00-21swapper/022:26:530
245772230,1sleep30-21swapper/321:32:533
1825499221,3cyclictest0-21swapper/222:00:112
1825399210,19cyclictest0-21swapper/119:45:131
1825299210,16cyclictest0-21swapper/023:12:040
1825299210,16cyclictest0-21swapper/023:04:020
1825599201,2cyclictest0-21swapper/320:45:083
1825299200,15cyclictest0-21swapper/022:13:050
1825299200,15cyclictest0-21swapper/000:28:050
162802200,1sleep0101ktimersoftd/021:25:000
1825599191,16cyclictest13925-21ssh23:05:113
18252991916,2cyclictest7736-21kworker/u8:121:54:050
1825299190,18cyclictest0-21swapper/022:08:050
1825299190,15cyclictest0-21swapper/021:40:040
18252991815,2cyclictest20571-21kworker/u8:123:48:040
1825299180,13cyclictest0-21swapper/019:24:010
38592170,0sleep00-21swapper/022:54:430
1825599173,3cyclictest22511-21rm00:21:153
18252991714,2cyclictest27369-21kworker/u8:223:56:040
18252991714,2cyclictest21491-21kworker/u8:021:32:040
18252991714,2cyclictest20571-21kworker/u8:100:04:060
18252991714,2cyclictest13385-21kworker/u8:022:31:040
1825299170,12cyclictest0-21swapper/021:12:050
1825299170,12cyclictest0-21swapper/020:19:040
1825299170,12cyclictest0-21swapper/020:14:040
1825599161,13cyclictest27784-21ssh23:19:283
18255991611,3cyclictest0-21swapper/322:25:163
18252991613,2cyclictest8835-21kworker/u8:121:39:050
18252991613,2cyclictest5941-21kworker/u8:300:39:040
1825299160,15cyclictest0-21swapper/023:19:040
1825299160,14cyclictest0-21swapper/023:30:050
1825599151,12cyclictest3875-21ssh22:18:053
1825599150,13cyclictest17302-21runrttasks22:33:183
1825599150,13cyclictest0-21swapper/320:05:153
1825499151,12cyclictest30285-21timerandwakeup23:21:052
1825499151,12cyclictest29-21rcuc/222:56:022
18254991510,3cyclictest0-21swapper/221:05:192
1825499150,2cyclictest29-21rcuc/221:30:152
1825399151,12cyclictest11260-21ssh00:09:141
18253991510,3cyclictest22722-21perl22:40:121
18253991510,3cyclictest0-21swapper/100:16:151
1825399150,2cyclictest0-21swapper/121:20:551
1825399150,13cyclictest0-21swapper/100:01:401
18252991512,2cyclictest9212-21kworker/u8:200:08:040
18252991512,2cyclictest27540-21kworker/u8:223:38:040
18252991512,2cyclictest22839-21kworker/u8:200:22:040
1825299150,14cyclictest0-21swapper/021:08:010
1825599149,3cyclictest10459-21ssh21:18:363
1825599142,7cyclictest0-21swapper/300:30:003
1825599141,2cyclictest10650-21ssh21:51:113
1825599141,11cyclictest0-21swapper/322:07:513
18255991410,2cyclictest0-21swapper/321:49:053
1825599140,3cyclictest20978-21ssh22:38:393
1825599140,12cyclictest0-21swapper/323:21:153
1825599140,12cyclictest0-21swapper/322:43:513
1825599140,12cyclictest0-21swapper/321:42:073
1825499149,3cyclictest0-21swapper/223:53:132
1825499142,7cyclictest0-21swapper/221:29:592
1825499142,7cyclictest0-21swapper/220:30:002
1825499142,7cyclictest0-21swapper/219:30:002
1825499142,6cyclictest0-21swapper/221:00:002
18254991411,2cyclictest301ktimersoftd/221:36:042
1825499141,11cyclictest0-21swapper/222:40:542
1825499140,12cyclictest301ktimersoftd/221:10:162
1825399149,3cyclictest26748-21sh23:17:521
1825399141,2cyclictest7157-21python20:01:011
18253991411,2cyclictest1498-21diskmemload22:48:531
18253991411,2cyclictest0-21swapper/122:50:421
18253991411,2cyclictest0-21swapper/122:28:421
18253991411,2cyclictest0-21swapper/121:56:021
18253991411,2cyclictest0-21swapper/100:33:321
1825399140,3cyclictest0-21swapper/100:10:471
1825399140,2cyclictest0-21swapper/123:27:431
1825399140,2cyclictest0-21swapper/121:37:431
1825399140,2cyclictest0-21swapper/100:25:031
1825399140,12cyclictest0-21swapper/123:25:001
18252991411,2cyclictest8835-21kworker/u8:121:16:050
1825299140,2cyclictest0-21swapper/019:26:050
1825299140,13cyclictest0-21swapper/021:56:050
1825299140,12cyclictest0-21swapper/000:10:200
208602130,2sleep20-21swapper/222:38:302
1825599139,2cyclictest21234-21ssh22:02:273
1825599132,6cyclictest0-21swapper/323:15:013
1825599132,6cyclictest0-21swapper/319:15:003
1825599131,2cyclictest387-21ssh23:57:063
18255991310,2cyclictest0-21swapper/323:52:183
18255991310,2cyclictest0-21swapper/323:43:073
18255991310,2cyclictest0-21swapper/322:12:323
18255991310,2cyclictest0-21swapper/321:59:013
18255991310,2cyclictest0-21swapper/321:28:293
18255991310,2cyclictest0-21swapper/321:06:093
18255991310,2cyclictest0-21swapper/319:50:173
1825599130,2cyclictest0-21swapper/321:13:263
1825599130,12cyclictest0-21swapper/321:35:193
1825599130,12cyclictest0-21swapper/320:00:003
1825599130,11cyclictest0-21swapper/300:01:293
1825499138,3cyclictest3288-21hostname00:00:142
1825499138,3cyclictest0-21swapper/223:41:262
1825499131,3cyclictest0-21swapper/223:29:022
1825499130,2cyclictest31-21ksoftirqd/219:15:122
1825499130,2cyclictest0-21swapper/219:40:142
1825499130,2cyclictest0-21swapper/200:09:432
1825499130,12cyclictest0-21swapper/220:01:012
1825499130,11cyclictest0-21swapper/219:35:132
1825499130,11cyclictest0-21swapper/200:31:172
1825399134,7cyclictest0-21swapper/121:50:171
18253991310,2cyclictest0-21swapper/123:58:421
18253991310,2cyclictest0-21swapper/123:40:351
18253991310,2cyclictest0-21swapper/123:34:501
18253991310,2cyclictest0-21swapper/121:40:111
18253991310,2cyclictest0-21swapper/121:30:071
18253991310,2cyclictest0-21swapper/100:37:021
18253991310,2cyclictest0-21swapper/100:21:321
1825399130,2cyclictest0-21swapper/123:35:161
1825399130,2cyclictest0-21swapper/123:06:481
1825399130,2cyclictest0-21swapper/121:12:541
1825399130,2cyclictest0-21swapper/120:46:001
1825399130,2cyclictest0-21swapper/119:15:171
1825399130,12cyclictest0-21swapper/123:45:131
1825399130,12cyclictest0-21swapper/123:10:131
1825399130,12cyclictest0-21swapper/122:20:141
1825399130,12cyclictest0-21swapper/122:15:101
1825399130,12cyclictest0-21swapper/121:46:011
1825399130,12cyclictest0-21swapper/120:25:131
1825399130,11cyclictest0-21swapper/120:40:391
18252991310,2cyclictest903-21kworker/u8:023:26:050
18252991310,2cyclictest24156-21kworker/u8:022:45:040
18252991310,2cyclictest22540-21kworker/u8:219:35:040
18252991310,2cyclictest20571-21kworker/u8:123:50:050
18252991310,2cyclictest1429-21kworker/u8:200:34:050
18252991310,2cyclictest0-21swapper/022:17:020
18252991310,2cyclictest0-21swapper/020:41:010
18252991310,2cyclictest0-21swapper/019:41:020
1825299130,8cyclictest0-21swapper/021:03:040
1825299130,2cyclictest0-21swapper/000:16:220
1825299130,12cyclictest0-21swapper/020:39:040
1825599129,2cyclictest8037-21ssh23:31:163
1825599129,2cyclictest0-21swapper/300:17:243
1825599122,7cyclictest0-21swapper/320:39:583
1825599120,2cyclictest11903-21ssh23:35:263
1825599120,2cyclictest0-21swapper/323:25:133
1825599120,2cyclictest0-21swapper/300:30:043
1825599120,11cyclictest0-21swapper/323:45:373
1825599120,11cyclictest0-21swapper/322:58:213
1825599120,11cyclictest0-21swapper/322:51:493
1825599120,11cyclictest0-21swapper/321:21:113
1825599120,11cyclictest0-21swapper/320:10:173
1825599120,11cyclictest0-21swapper/300:36:523
1825599120,11cyclictest0-21swapper/300:11:083
1825599120,11cyclictest0-21swapper/300:05:553
1825499129,2cyclictest29-21rcuc/200:26:252
1825499129,2cyclictest0-21swapper/221:55:132
1825499129,2cyclictest0-21swapper/221:41:272
1825499129,2cyclictest0-21swapper/221:00:142
1825499122,7cyclictest0-21swapper/219:24:022
1825499121,6cyclictest0-21swapper/223:40:012
1825499121,6cyclictest0-21swapper/200:40:002
1825499120,3cyclictest24579-21ntp_kernel_pll_23:15:192
1825499120,2cyclictest0-21swapper/222:50:162
1825499120,2cyclictest0-21swapper/219:51:022
1825499120,11cyclictest31-21ksoftirqd/223:45:132
1825499120,11cyclictest31-21ksoftirqd/220:45:142
1825499120,11cyclictest0-21swapper/223:12:242
1825499120,11cyclictest0-21swapper/222:45:042
1825499120,11cyclictest0-21swapper/222:25:032
1825499120,11cyclictest0-21swapper/222:24:342
1825499120,11cyclictest0-21swapper/200:21:232
1825399129,2cyclictest0-21swapper/121:25:171
1825399129,2cyclictest0-21swapper/120:05:141
1825399127,3cyclictest24541-21munin-node1
1825399127,3cyclictest0-21swapper/122:05:181
1825399121,9cyclictest28173-21apt-get19:35:121
1825399121,3cyclictest0-21swapper/119:55:181
1825399120,2cyclictest0-21swapper/123:02:081
1825399120,2cyclictest0-21swapper/122:35:541
1825399120,11cyclictest0-21swapper/122:30:171
1825399120,11cyclictest0-21swapper/122:10:071
1825399120,11cyclictest0-21swapper/122:01:341
1825399120,11cyclictest0-21swapper/120:16:031
1825299129,2cyclictest9363-21kworker/u8:019:19:040
1825299129,2cyclictest9077-21kworker/u8:020:30:020
1825299129,2cyclictest3449-21kworker/u8:022:56:040
1825299129,2cyclictest21560-21kworker/u8:020:46:050
1825299129,2cyclictest18534-21kworker/u8:122:02:050
1825299129,2cyclictest18487-21kworker/u8:122:35:050
1825299129,2cyclictest0-21swapper/022:21:110
1825299122,7cyclictest0-21swapper/020:55:020
1825299122,7cyclictest0-21swapper/020:23:020
1825299122,7cyclictest0-21swapper/020:09:020
1825299122,7cyclictest0-21swapper/019:53:580
1825299122,6cyclictest0-21swapper/023:06:490
1825299120,3cyclictest23425-21sh22:40:320
1825299120,2cyclictest0-21swapper/021:47:530
168342120,2sleep20-21swapper/223:07:312
153952120,2sleep20-21swapper/221:23:432
48862110,2sleep20-21swapper/219:55:192
317142110,2sleep20-21swapper/223:55:572
300452110,1sleep00-21swapper/023:21:000
1825599112,6cyclictest0-21swapper/320:16:023
1825599111,7cyclictest0-21swapper/320:22:583
1825599110,2cyclictest0-21swapper/320:50:223
1825599110,1cyclictest0-21swapper/319:25:003
1825499118,2cyclictest0-21swapper/223:30:192
1825499117,2cyclictest0-21swapper/220:35:142
1825499112,6cyclictest0-21swapper/220:17:592
1825499111,6cyclictest24835-21ssh22:06:012
1825499111,6cyclictest0-21swapper/220:21:082
1825499110,9cyclictest0-21swapper/223:02:402
1825499110,2cyclictest0-21swapper/221:15:242
1825499110,10cyclictest0-21swapper/222:15:022
1825399117,2cyclictest28127-21munin-node1
1825399117,2cyclictest0-21swapper/120:54:591
1825399111,8cyclictest0-21swapper/119:40:171
1825399111,5cyclictest0-21swapper/119:20:011
1825399111,3cyclictest0-21swapper/120:20:141
1825399111,2cyclictest32178-21apt-get21:05:161
1825399110,9cyclictest0-21swapper/121:00:111
1825399110,9cyclictest0-21swapper/119:50:141
1825399110,9cyclictest0-21swapper/119:10:141
1825399110,3cyclictest0-21swapper/120:35:141
1825399110,3cyclictest0-21swapper/120:31:041
1825399110,3cyclictest0-21swapper/120:11:031
1825299118,2cyclictest6174-21cpu20:00:120
1825299118,2cyclictest28270-21kworker/u8:119:49:050
1825299118,2cyclictest23146-21kworker/u8:119:11:050
1825299118,2cyclictest1902-21kworker/u8:221:27:040
1825299112,6cyclictest0-21swapper/019:34:590
1825299112,6cyclictest0-21swapper/019:34:580
1825299110,2cyclictest0-21swapper/020:50:040
1825299110,2cyclictest0-21swapper/019:56:040
111242110,2sleep20-21swapper/221:51:562
198302100,8sleep20-21swapper/220:34:432
1825599106,2cyclictest21050-21hddtemp_smartct19:15:153
1825599105,3cyclictest29915-21cron21:00:003
1825599101,6cyclictest0-21swapper/320:26:013
1825599100,8cyclictest14145-21kworker/u8:120:34:053
1825599100,2cyclictest0-21swapper/319:56:053
1825499107,2cyclictest1498-21diskmemload00:17:092
1825499107,2cyclictest0-21swapper/219:30:182
1825499107,2cyclictest0-21swapper/219:30:182
1825499105,3cyclictest4883-21sh21:45:252
1825499103,2cyclictest29-21rcuc/220:06:242
1825499100,9cyclictest0-21swapper/200:11:402
1825499100,2cyclictest0-21swapper/220:53:252
162762100,2sleep20-21swapper/222:31:442
182559994,3cyclictest32449-21cpuspeed_turbos19:45:143
182559994,3cyclictest31046-21tail19:40:183
182559994,3cyclictest30485-21sed21:00:123
182559994,3cyclictest26871-21df_abs19:30:133
182559994,3cyclictest26871-21df_abs19:30:123
182559994,3cyclictest22892-21grep20:40:173
182559990,8cyclictest0-21swapper/319:36:063
182559990,4cyclictest0-21swapper/319:24:023
182549994,3cyclictest10272-21tr20:10:132
182549990,8cyclictest0-21swapper/220:41:012
182549990,2cyclictest0-21swapper/219:45:232
182539996,2cyclictest0-21swapper/119:30:181
182539996,2cyclictest0-21swapper/119:30:171
182529990,8cyclictest0-21swapper/023:41:190
182549983,3cyclictest18526-21aten2.4-expect19:10:122
182529985,2cyclictest9077-21kworker/u8:020:26:010
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional