You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-01-08 - 18:31

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot5s.osadl.org (updated Thu Jan 08, 2026 12:44:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2489999252,2cyclictest21528-21apt-get11:41:280
2490199240,23cyclictest0-21swapper/209:16:282
24899992419,4cyclictest0-21swapper/009:11:280
24902992323,0cyclictest19305-21apt-get09:16:283
24900992321,1cyclictest23922-21apt-get11:46:281
2490099230,2cyclictest12496-21idleruntime-cro07:55:011
2490099230,22cyclictest13925-21apt-get11:26:281
2490099230,22cyclictest0-21swapper/111:01:271
24899992321,1cyclictest0-21swapper/011:15:010
2489999230,2cyclictest1485-21idleruntime-cro11:00:000
24902992220,1cyclictest12489-21perf07:55:013
2490299220,21cyclictest26877-21cron08:25:003
2490299220,21cyclictest16322-21apt-get11:31:293
2490299220,21cyclictest14895-21ls08:00:013
2490299220,21cyclictest11155-21sendmail-msp11:20:013
2490299220,1cyclictest30064-21apt-get07:21:273
24901992220,1cyclictest29314-21apt-get09:36:292
2490199220,21cyclictest0-21swapper/211:20:012
2490199220,21cyclictest0-21swapper/208:06:282
2490199220,21cyclictest0-21swapper/208:01:292
2490199220,1cyclictest16449-21apt10:20:012
2490199220,1cyclictest0-21swapper/208:31:272
24900992221,1cyclictest0-21swapper/108:41:291
24900992221,0cyclictest0-21swapper/109:46:241
24900992220,1cyclictest211rcuc/109:10:001
24900992220,1cyclictest15218-21munin-run12:35:001
24900992220,1cyclictest0-21swapper/112:15:011
24900992220,1cyclictest0-21swapper/107:35:001
2490099220,21cyclictest0-21swapper/111:51:281
2490099220,21cyclictest0-21swapper/108:36:271
2490099220,1cyclictest0-21swapper/110:06:281
24899992222,0cyclictest0-21swapper/007:56:240
24899992220,1cyclictest27291-21awk07:15:010
24899992220,1cyclictest0-21swapper/010:10:000
2489999220,21cyclictest31505-21latency_hist10:55:000
2489999220,21cyclictest24869-21apt-get08:21:270
2489999220,21cyclictest18716-21apt-get11:36:280
2489999220,21cyclictest0-21swapper/008:16:290
24902992120,1cyclictest9617-21apt-get10:06:283
24902992120,0cyclictest0-21swapper/308:01:293
24902992119,1cyclictest606-21dbus-daemon11:10:013
2490299210,21cyclictest0-21swapper/309:56:293
2490299210,21cyclictest0-21swapper/309:46:253
2490299210,20cyclictest26326-21apt-get11:51:283
2490299210,20cyclictest0-21swapper/312:31:293
2490299210,1cyclictest19699-21munin-plugin-st08:10:013
2490299210,0cyclictest0-21swapper/312:01:283
24901992120,1cyclictest0-21swapper/208:21:272
24901992120,0cyclictest21610-21apt-get10:31:262
24901992119,1cyclictest8389-21apt-get12:21:302
24901992119,1cyclictest6720-21apt-get11:11:292
24901992119,1cyclictest1497-21awk11:00:002
24901992118,2cyclictest26303-21sshd10:40:102
2490199210,20cyclictest0-21swapper/212:26:292
2490199210,20cyclictest0-21swapper/209:21:282
24900992121,0cyclictest0-21swapper/112:36:291
24900992121,0cyclictest0-21swapper/108:51:271
24900992121,0cyclictest0-21swapper/108:26:281
24900992120,0cyclictest0-21swapper/109:16:291
24900992119,1cyclictest7005-21cron07:40:001
24900992119,1cyclictest0-21swapper/109:36:281
24900992118,2cyclictest20777-21basename11:40:001
2490099210,21cyclictest0-21swapper/110:16:271
2490099210,21cyclictest0-21swapper/109:26:281
2490099210,20cyclictest24007-21apt-get10:36:281
2490099210,20cyclictest0-21swapper/112:26:291
2490099210,1cyclictest609-21rs:main1
2490099210,0cyclictest11724-21apt-get09:01:281
2490099210,0cyclictest0-21swapper/110:46:251
24899992121,0cyclictest0-21swapper/011:56:280
24899992121,0cyclictest0-21swapper/011:46:280
24899992120,1cyclictest29665-21apt-get08:31:270
24899992120,1cyclictest21724-21apt-get09:21:280
24899992120,1cyclictest0-21swapper/010:36:280
24899992120,0cyclictest2073-21apt-get08:41:290
24899992119,1cyclictest11533-21apt-get11:21:300
2489999210,1cyclictest10427-21awk12:25:000
2489999210,0cyclictest0-21swapper/012:11:290
24902992020,0cyclictest10781-21apt-get12:26:293
24902992020,0cyclictest0-21swapper/309:06:283
24902992020,0cyclictest0-21swapper/307:16:293
24902992019,1cyclictest32061-21apt-get08:36:273
24902992019,1cyclictest20740-21apt-get11:40:023
24902992018,1cyclictest0-21swapper/311:30:013
2490299200,20cyclictest0-21swapper/310:46:253
2490299200,20cyclictest0-21swapper/310:36:283
2490299200,0cyclictest6911-21apt-get08:51:273
2490299200,0cyclictest0-21swapper/310:51:303
2490299200,0cyclictest0-21swapper/309:35:023
2490299200,0cyclictest0-21swapper/309:21:283
2490299200,0cyclictest0-21swapper/309:01:273
24901992020,0cyclictest0-21swapper/211:01:272
24901992020,0cyclictest0-21swapper/210:46:252
24901992020,0cyclictest0-21swapper/209:01:282
24901992020,0cyclictest0-21swapper/207:31:282
24901992019,0cyclictest0-21swapper/208:51:272
24901992018,1cyclictest0-21swapper/211:30:012
2490199200,19cyclictest0-21swapper/211:31:292
2490199200,0cyclictest0-21swapper/212:31:292
2490199200,0cyclictest0-21swapper/212:01:282
2490199200,0cyclictest0-21swapper/210:36:282
24900992020,0cyclictest0-21swapper/110:31:261
24900992020,0cyclictest0-21swapper/108:46:281
24900992020,0cyclictest0-21swapper/108:31:271
24900992020,0cyclictest0-21swapper/108:16:291
24900992018,1cyclictest4808-21apt-get09:56:291
24900992018,1cyclictest22059-21sh08:15:001
24900992018,1cyclictest0-21swapper/110:45:001
2490099200,20cyclictest0-21swapper/111:11:291
2490099200,20cyclictest0-21swapper/107:11:291
2490099200,0cyclictest0-21swapper/112:21:301
2490099200,0cyclictest0-21swapper/107:56:251
24899992020,0cyclictest9112-21apt-get11:16:270
24899992020,0cyclictest27073-21apt-get10:46:250
24899992020,0cyclictest26522-21apt-get09:31:280
24899992020,0cyclictest19216-21apt-get10:26:280
24899992020,0cyclictest0-21swapper/012:31:290
24899992020,0cyclictest0-21swapper/012:16:280
24899992020,0cyclictest0-21swapper/012:06:280
24899992020,0cyclictest0-21swapper/011:06:290
24899992020,0cyclictest0-21swapper/008:11:280
24899992020,0cyclictest0-21swapper/007:36:270
24899992020,0cyclictest0-21swapper/007:31:280
2489999200,20cyclictest0-21swapper/009:35:020
24902991919,0cyclictest1876-21apt-get11:01:273
24902991919,0cyclictest0-21swapper/310:16:273
24902991919,0cyclictest0-21swapper/307:31:283
24902991918,1cyclictest4520-21apt-get08:46:283
24901991919,0cyclictest0-21swapper/212:36:282
24901991919,0cyclictest0-21swapper/211:56:292
24901991919,0cyclictest0-21swapper/209:26:282
24901991919,0cyclictest0-21swapper/208:46:282
24901991919,0cyclictest0-21swapper/208:36:272
24901991919,0cyclictest0-21swapper/208:26:272
24901991918,1cyclictest3576-21apt-get12:11:292
24901991918,0cyclictest0-21swapper/208:41:292
24901991917,1cyclictest26522-21apt-get09:31:282
24901991916,2cyclictest7028-21turbostat.cron07:40:002
24901991916,0cyclictest0-21swapper/211:51:282
24900991919,0cyclictest0-21swapper/110:56:281
24900991918,0cyclictest0-21swapper/112:06:281
2490099190,19cyclictest0-21swapper/111:21:301
24899991919,0cyclictest0-21swapper/012:26:290
24899991919,0cyclictest0-21swapper/011:31:280
24899991919,0cyclictest0-21swapper/011:26:280
24899991919,0cyclictest0-21swapper/010:01:260
24899991919,0cyclictest0-21swapper/008:51:270
24902991818,0cyclictest15572-21apt-get12:36:283
24902991818,0cyclictest0-21swapper/312:21:303
24902991818,0cyclictest0-21swapper/311:56:293
24902991818,0cyclictest0-21swapper/311:11:293
24902991818,0cyclictest0-21swapper/310:31:263
24902991818,0cyclictest0-21swapper/309:26:283
24902991817,1cyclictest25255-21apt-get07:11:293
24902991817,1cyclictest1500-21sendmail-msp11:00:003
24902991817,0cyclictest0-21swapper/311:46:283
24902991815,2cyclictest20767-21munin-run11:40:003
24901991818,0cyclictest0-21swapper/211:46:282
24901991818,0cyclictest0-21swapper/210:11:292
24901991818,0cyclictest0-21swapper/207:11:292
24901991817,0cyclictest16156-21munin-run09:10:002
24901991817,0cyclictest0-21swapper/210:51:302
24901991816,1cyclictest9814-21apt-get07:46:302
24901991816,1cyclictest20773-21sendmail-msp11:40:002
24901991816,1cyclictest0-21swapper/208:15:002
24900991818,0cyclictest0-21swapper/112:16:281
24900991818,0cyclictest0-21swapper/112:01:291
24900991818,0cyclictest0-21swapper/111:16:271
24900991818,0cyclictest0-21swapper/110:21:281
24900991817,1cyclictest18355-21perf11:35:001
24900991817,1cyclictest16149-21apt-get09:10:021
2490099180,18cyclictest0-21swapper/110:51:301
24899991818,0cyclictest0-21swapper/010:21:280
24899991818,0cyclictest0-21swapper/009:01:280
24899991817,1cyclictest27269-21apt-get08:26:280
24899991817,1cyclictest0-21swapper/010:16:270
24902991717,0cyclictest0-21swapper/312:11:293
24902991717,0cyclictest0-21swapper/310:11:293
24902991717,0cyclictest0-21swapper/309:31:283
24902991717,0cyclictest0-21swapper/308:41:293
24902991717,0cyclictest0-21swapper/308:26:273
24902991716,1cyclictest0-21swapper/308:31:273
24902991715,1cyclictest22053-21cron08:15:003
24902991715,1cyclictest0-21swapper/307:46:303
24901991717,0cyclictest0-21swapper/211:21:302
24901991717,0cyclictest0-21swapper/209:46:242
24901991717,0cyclictest0-21swapper/208:16:292
24901991714,2cyclictest0-21swapper/210:10:002
2490199170,16cyclictest0-21swapper/210:05:002
2490199170,0cyclictest0-21swapper/212:06:282
2490199170,0cyclictest0-21swapper/207:26:272
24900991717,0cyclictest0-21swapper/107:16:291
24899991717,0cyclictest14118-21apt-get09:06:270
24899991717,0cyclictest0-21swapper/008:36:280
24899991716,0cyclictest27649-21apt-get07:16:290
24902991616,0cyclictest0-21swapper/311:21:303
24902991616,0cyclictest0-21swapper/308:16:293
24902991615,1cyclictest5968-21apt-get12:16:283
24902991614,2cyclictest7024-21tr07:40:003
24902991614,1cyclictest26717-21munin-run10:45:003
24901991616,0cyclictest0-21swapper/211:06:292
24901991614,1cyclictest0-21swapper/207:21:272
24900991616,0cyclictest0-21swapper/107:21:261
24900991614,1cyclictest14044-21wc10:15:011
24900991614,1cyclictest0-21swapper/107:26:331
24899991616,0cyclictest0-21swapper/011:01:270
24899991616,0cyclictest0-21swapper/010:31:260
24899991616,0cyclictest0-21swapper/007:41:280
24899991614,1cyclictest17287-21latency_hist08:05:010
2489999160,15cyclictest17569-21cron12:40:000
2489999160,15cyclictest0-21swapper/007:25:000
24902991514,0cyclictest1113-21apt-get12:06:283
2490299150,1cyclictest16149-21apt-get09:10:013
24901991515,0cyclictest0-21swapper/212:16:282
24901991515,0cyclictest0-21swapper/210:21:282
24901991515,0cyclictest0-21swapper/209:56:292
24900991515,0cyclictest0-21swapper/108:06:281
24900991515,0cyclictest0-21swapper/108:01:291
24900991513,1cyclictest9453-21awk07:45:011
2490099150,1cyclictest0-21swapper/108:21:281
2490099150,14cyclictest28632-21chrt11:55:421
2490099150,0cyclictest0-21swapper/111:40:011
24899991515,0cyclictest26163-21munin-run09:30:010
24899991515,0cyclictest0-21swapper/007:46:300
24899991514,1cyclictest1994-21munin-run09:50:010
24899991513,1cyclictest607-21in:imuxsock08:10:010
24899991513,1cyclictest32458-21apt-get07:26:270
24899991512,2cyclictest4415-21cron09:55:000
24902991414,0cyclictest0-21swapper/309:50:033
24902991414,0cyclictest0-21swapper/308:55:033
2490299140,14cyclictest0-21swapper/307:40:453
2490299140,14cyclictest0-21swapper/307:25:033
2490299140,0cyclictest0-21swapper/310:26:113
2490299140,0cyclictest0-21swapper/310:20:023
2490299140,0cyclictest0-21swapper/310:00:383
2490299140,0cyclictest0-21swapper/309:41:083
24901991414,0cyclictest0-21swapper/209:10:022
2490199140,14cyclictest0-21swapper/211:40:372
2490199140,14cyclictest0-21swapper/209:50:032
2490199140,14cyclictest0-21swapper/207:51:152
2490199140,14cyclictest0-21swapper/207:40:122
2490199140,0cyclictest0-21swapper/210:25:322
2490199140,0cyclictest0-21swapper/209:40:542
2490199140,0cyclictest0-21swapper/207:16:092
24900991414,0cyclictest0-21swapper/109:20:021
2490099140,14cyclictest0-21swapper/108:55:411
2490099140,0cyclictest0-21swapper/110:00:141
2490099140,0cyclictest0-21swapper/109:40:571
24899991414,0cyclictest0-21swapper/011:50:420
24899991414,0cyclictest0-21swapper/009:40:070
24899991414,0cyclictest0-21swapper/008:45:080
2489999140,14cyclictest0-21swapper/010:40:560
2489999140,14cyclictest0-21swapper/009:55:480
2489999140,14cyclictest0-21swapper/009:15:280
2489999140,14cyclictest0-21swapper/008:55:090
2489999140,0cyclictest0-21swapper/010:10:160
2489999140,0cyclictest0-21swapper/007:50:140
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional