You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-28 - 18:06

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Sun Dec 28, 2025 12:44:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
906299240,23cyclictest3784-21perf12:30:013
905999240,24cyclictest0-21swapper/207:55:312
905299240,23cyclictest3793-21basename12:30:010
9062992323,0cyclictest0-21swapper/309:20:333
906299230,22cyclictest17346-21wc10:45:013
906299230,22cyclictest16894-21apt-get07:25:023
906299230,22cyclictest16288-21munin-plugin-st07:25:013
905999230,2cyclictest26578-21awk12:10:002
905599230,22cyclictest6471-21apt-get12:35:311
905299230,22cyclictest0-21swapper/011:20:320
9062992221,1cyclictest606-21dbus-daemon11:00:013
9062992220,1cyclictest0-21swapper/311:25:013
906299220,21cyclictest7292-21munin-run10:25:003
906299220,21cyclictest18101-21munin-run09:40:003
906299220,21cyclictest16890-21apt-get11:50:333
906299220,21cyclictest16323-21apt-get08:30:323
906299220,1cyclictest8038-21idleruntime-cro09:20:013
906299220,1cyclictest16032-21munin-plugin-st08:30:013
906299220,1cyclictest0-21swapper/312:35:013
9059992220,1cyclictest0-21swapper/211:45:012
905999220,21cyclictest22100-21apt-get12:00:352
905999220,21cyclictest0-21swapper/210:30:342
905599222,19cyclictest16582-21cron11:50:011
9055992220,1cyclictest3229-21basename09:10:011
9055992220,1cyclictest24545-21perf11:00:011
9055992220,1cyclictest19077-21munin-run07:30:011
905599220,21cyclictest9623-21apt-get11:35:321
905599220,21cyclictest26321-21apt-get08:50:341
905599220,21cyclictest10476-21sh09:25:001
905599220,21cyclictest0-21swapper/112:05:001
905599220,21cyclictest0-21swapper/109:15:331
905599220,1cyclictest5624-21munin-run09:15:011
905599220,1cyclictest3579-21perf08:05:001
905599220,1cyclictest0-21swapper/108:50:001
905299220,21cyclictest31387-21cron12:20:010
905299220,21cyclictest0-21swapper/010:00:330
905299220,21cyclictest0-21swapper/009:50:320
905299220,21cyclictest0-21swapper/009:20:330
905299220,21cyclictest0-21swapper/009:15:330
9062992120,1cyclictest26321-21apt-get08:50:333
9062992120,1cyclictest0-21swapper/312:05:333
9062992120,0cyclictest26889-21apt-get12:10:353
906299210,20cyclictest3576-21grep08:05:003
906299210,20cyclictest31130-21apt-get09:00:323
906299210,20cyclictest12124-21apt-get10:35:023
906299210,20cyclictest0-21swapper/308:35:323
906299210,20cyclictest0-21swapper/308:10:323
9059992120,1cyclictest29069-21apt-get07:50:332
9059992120,1cyclictest18718-21apt-get08:35:322
9059992120,1cyclictest0-21swapper/208:50:332
9059992119,1cyclictest0-21swapper/210:10:312
905999210,21cyclictest0-21swapper/212:30:342
905999210,21cyclictest0-21swapper/208:15:362
905999210,20cyclictest6651-21apt-get08:10:322
905999210,20cyclictest23925-21apt-get08:45:332
905999210,20cyclictest0-21swapper/212:35:312
905999210,20cyclictest0-21swapper/211:00:332
905999210,0cyclictest22430-21apt-get10:55:342
905999210,0cyclictest0-21swapper/211:15:332
9055992121,0cyclictest23178-21apt-get09:50:331
9055992121,0cyclictest0-21swapper/110:45:351
9055992121,0cyclictest0-21swapper/109:25:331
9055992120,1cyclictest0-21swapper/111:30:301
905599211,1cyclictest0-21swapper/111:15:331
905599210,21cyclictest0-21swapper/108:55:321
9052992121,0cyclictest0-21swapper/012:10:350
9052992121,0cyclictest0-21swapper/008:25:320
9052992120,1cyclictest3580-21munin-run08:05:000
9052992120,1cyclictest28431-21munin-run08:55:000
9052992120,1cyclictest12825-21apt-get10:35:340
9052992120,1cyclictest0-21swapper/012:30:340
9052992120,1cyclictest0-21swapper/007:25:020
9052992120,0cyclictest0-21swapper/007:45:350
9052992120,0cyclictest0-21swapper/007:40:330
905299210,21cyclictest0-21swapper/008:20:330
905299210,21cyclictest0-21swapper/007:55:310
905299210,20cyclictest6651-21apt-get08:10:310
905299210,20cyclictest27239-21apt-get11:05:320
905299210,20cyclictest0-21swapper/010:45:340
905299210,20cyclictest0-21swapper/009:40:330
905299210,0cyclictest14179-21apt-get07:20:340
905299210,0cyclictest0-21swapper/012:35:310
905299210,0cyclictest0-21swapper/011:30:300
905299210,0cyclictest0-21swapper/008:30:320
905299210,0cyclictest0-21swapper/008:15:360
9062992020,0cyclictest0-21swapper/311:40:333
9062992020,0cyclictest0-21swapper/308:20:333
9062992018,1cyclictest31743-21perf11:15:003
9062992018,1cyclictest29279-21apt-get12:15:343
9062992018,1cyclictest23992-21awk07:40:013
9062992018,1cyclictest0-21swapper/309:45:013
906299200,20cyclictest0-21swapper/308:40:313
906299200,0cyclictest0-21swapper/311:05:323
906299200,0cyclictest0-21swapper/310:50:343
906299200,0cyclictest0-21swapper/310:00:333
9059992020,0cyclictest13573-21apt-get09:30:312
9059992020,0cyclictest0-21swapper/212:10:352
9059992020,0cyclictest0-21swapper/211:50:342
9059992020,0cyclictest0-21swapper/210:25:332
9059992020,0cyclictest0-21swapper/207:15:322
9059992019,1cyclictest21530-21apt-get08:40:312
9059992019,0cyclictest0-21swapper/212:15:342
9059992018,1cyclictest3794-21munin-plugin-st12:30:012
905999200,20cyclictest0-21swapper/207:35:322
905999200,19cyclictest0-21swapper/207:45:342
905999200,0cyclictest24281-21apt-get07:40:332
905999200,0cyclictest0-21swapper/212:20:362
905999200,0cyclictest0-21swapper/211:35:322
905999200,0cyclictest0-21swapper/208:00:342
9055992020,0cyclictest31461-21apt-get07:55:321
9055992020,0cyclictest0-21swapper/112:25:341
9055992020,0cyclictest0-21swapper/111:10:331
9055992020,0cyclictest0-21swapper/108:25:321
9055992019,1cyclictest9057-21apt-get08:15:361
9055992018,1cyclictest1365-21cron12:25:011
905599200,0cyclictest0-21swapper/109:40:331
905599200,0cyclictest0-21swapper/108:35:321
9052992020,0cyclictest0-21swapper/012:00:020
9052992020,0cyclictest0-21swapper/009:45:350
9052992020,0cyclictest0-21swapper/008:35:310
9052992018,1cyclictest0-21swapper/010:55:330
905299200,19cyclictest7572-21apt-get10:25:330
905299200,0cyclictest0-21swapper/012:20:350
905299200,0cyclictest0-21swapper/008:05:330
905299200,0cyclictest0-21swapper/007:30:320
9062991919,0cyclictest0-21swapper/311:30:313
9062991919,0cyclictest0-21swapper/309:55:333
9062991919,0cyclictest0-21swapper/307:55:323
9062991919,0cyclictest0-21swapper/307:15:313
9062991918,1cyclictest2760-21apt-get10:15:323
9062991918,1cyclictest0-21swapper/309:30:023
9059991919,0cyclictest1103-21apt-get09:05:332
9059991919,0cyclictest0-21swapper/210:20:352
9059991919,0cyclictest0-21swapper/210:00:012
9059991919,0cyclictest0-21swapper/209:35:332
9059991919,0cyclictest0-21swapper/209:00:322
9059991918,1cyclictest27990-21apt-get10:00:332
9055991919,0cyclictest0-21swapper/111:05:321
9055991919,0cyclictest0-21swapper/110:10:301
9055991919,0cyclictest0-21swapper/108:05:331
9055991919,0cyclictest0-21swapper/107:45:351
9055991919,0cyclictest0-21swapper/107:20:331
9055991918,1cyclictest0-21swapper/109:30:311
9055991918,0cyclictest0-21swapper/108:40:021
905599190,0cyclictest0-21swapper/109:35:321
9052991919,0cyclictest0-21swapper/008:40:310
9052991918,1cyclictest25574-21apt-get09:55:330
9052991918,0cyclictest0-21swapper/009:00:320
9052991917,1cyclictest13889-21munin-plugin-st07:20:010
9052991917,1cyclictest1-21systemd11:30:010
9052991917,1cyclictest1-21systemd11:30:010
9062991818,0cyclictest0-21swapper/310:25:333
9062991818,0cyclictest0-21swapper/307:50:333
9062991817,0cyclictest0-21swapper/311:00:333
9062991816,1cyclictest5968-21awk08:10:013
9062991816,1cyclictest1736-21turbostat11:20:003
9059991818,0cyclictest8325-21apt-get09:20:332
9059991818,0cyclictest2036-21apt-get11:20:322
9059991818,0cyclictest0-21swapper/207:20:342
9059991817,1cyclictest6528-21apt-get11:30:022
9059991815,2cyclictest16965-21apt-get07:25:312
905999180,1cyclictest313-21systemd-journal08:35:012
9055991818,0cyclictest5952-21apt-get08:10:021
9055991818,0cyclictest0-21swapper/112:30:341
9055991818,0cyclictest0-21swapper/112:15:341
9055991818,0cyclictest0-21swapper/110:40:331
9055991818,0cyclictest0-21swapper/110:35:351
9055991816,1cyclictest26919-21cron11:05:001
9055991816,1cyclictest13882-21perf07:20:011
9052991818,0cyclictest1103-21apt-get09:05:340
9052991818,0cyclictest0-21swapper/011:15:330
9052991818,0cyclictest0-21swapper/009:30:310
9052991818,0cyclictest0-21swapper/009:10:320
9052991818,0cyclictest0-21swapper/008:45:330
9052991818,0cyclictest0-21swapper/007:10:310
9052991817,1cyclictest30382-21apt-get10:05:330
9052991817,0cyclictest0-21swapper/011:10:330
9062991717,0cyclictest19362-21apt-get07:30:323
9062991717,0cyclictest0-21swapper/312:00:353
9062991717,0cyclictest0-21swapper/310:45:343
9062991716,1cyclictest9976-21apt-get10:30:343
9062991716,1cyclictest14497-21apt-get11:45:363
9062991713,3cyclictest6531-21idleruntime-cro11:30:013
9062991713,3cyclictest6531-21idleruntime-cro11:30:013
9059991717,0cyclictest3864-21apt-get08:05:332
9059991717,0cyclictest17639-21apt-get10:45:342
9059991717,0cyclictest11534-21apt-get08:20:332
9059991717,0cyclictest0-21swapper/211:05:322
9059991717,0cyclictest0-21swapper/209:50:322
9059991717,0cyclictest0-21swapper/209:15:332
9059991717,0cyclictest0-21swapper/207:30:322
9059991717,0cyclictest0-21swapper/207:10:312
9055991717,0cyclictest13646-21perf08:25:011
9055991717,0cyclictest0-21swapper/110:20:351
9055991717,0cyclictest0-21swapper/109:00:321
9055991716,1cyclictest0-21swapper/110:25:331
9055991715,1cyclictest0-21swapper/112:10:001
9052991717,0cyclictest0-21swapper/011:50:330
9052991717,0cyclictest0-21swapper/011:45:360
905299170,1cyclictest606-21dbus-daemon10:15:000
905299170,0cyclictest0-21swapper/009:35:330
9062991614,1cyclictest9942-21sed07:10:333
906299160,0cyclictest0-21swapper/309:05:343
9059991616,0cyclictest20786-21apt-get09:45:342
9059991616,0cyclictest0-21swapper/211:10:332
9059991616,0cyclictest0-21swapper/209:40:332
9059991616,0cyclictest0-21swapper/208:25:322
905999160,15cyclictest5711-21ptp4l-jitter11:25:402
905999160,15cyclictest5711-21ptp4l-jitter11:25:402
9055991616,0cyclictest4429-21apt-get11:25:331
9055991616,0cyclictest4429-21apt-get11:25:331
9055991616,0cyclictest0-21swapper/108:30:321
905599160,15cyclictest10407-21ntp_states07:10:361
9052991616,0cyclictest0-21swapper/011:55:330
9052991616,0cyclictest0-21swapper/011:40:330
9052991616,0cyclictest0-21swapper/011:00:320
905299160,15cyclictest4896-21awk10:20:000
9062991515,0cyclictest0-21swapper/310:05:333
9062991515,0cyclictest0-21swapper/309:25:333
9062991515,0cyclictest0-21swapper/308:15:353
9062991514,1cyclictest0-21swapper/307:41:183
906299150,4cyclictest0-21swapper/311:55:333
9059991515,0cyclictest0-21swapper/210:35:342
9059991513,1cyclictest29513-21irqstats08:55:352
9055991515,0cyclictest0-21swapper/109:55:331
905599150,1cyclictest0-21swapper/110:00:361
9052991514,1cyclictest5181-21apt-get10:20:350
905299150,1cyclictest0-21swapper/008:55:350
9062991414,0cyclictest0-21swapper/312:35:313
9062991414,0cyclictest0-21swapper/309:10:213
9062991414,0cyclictest0-21swapper/307:45:203
906299140,14cyclictest0-21swapper/312:21:223
906299140,14cyclictest0-21swapper/311:36:013
906299140,14cyclictest0-21swapper/310:10:083
906299140,14cyclictest0-21swapper/309:47:153
906299140,14cyclictest0-21swapper/308:55:183
906299140,0cyclictest0-21swapper/309:50:223
906299140,0cyclictest0-21swapper/308:47:303
9059991414,0cyclictest0-21swapper/210:15:092
9059991413,1cyclictest3512-21apt-get09:10:322
905999140,14cyclictest0-21swapper/211:56:272
905999140,14cyclictest0-21swapper/210:50:132
905999140,14cyclictest0-21swapper/210:06:502
905999140,0cyclictest0-21swapper/211:45:202
905999140,0cyclictest0-21swapper/210:40:562
905999140,0cyclictest0-21swapper/209:25:142
9055991414,0cyclictest0-21swapper/111:50:301
9055991414,0cyclictest0-21swapper/107:40:121
905599140,14cyclictest0-21swapper/111:40:061
905599140,14cyclictest0-21swapper/110:15:261
905599140,14cyclictest0-21swapper/110:07:241
905599140,0cyclictest0-21swapper/111:55:121
905599140,0cyclictest0-21swapper/111:21:021
9052991414,0cyclictest0-21swapper/011:35:320
9052991414,0cyclictest0-21swapper/010:30:330
9052991414,0cyclictest0-21swapper/007:50:450
905299140,14cyclictest0-21swapper/012:05:180
905299140,14cyclictest0-21swapper/010:40:200
905299140,14cyclictest0-21swapper/009:25:170
905299140,14cyclictest0-21swapper/007:35:400
905299140,10cyclictest0-21swapper/010:50:340
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional