You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-29 - 22:14

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Mon Dec 29, 2025 12:44:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1088299240,23cyclictest0-21swapper/210:30:372
1088199240,23cyclictest17985-21cron11:50:001
1088099240,23cyclictest2152-21kworker/0:207:45:370
1088099240,1cyclictest11835-21apt-get10:30:370
1088099240,1cyclictest0-21swapper/008:50:360
10883992321,1cyclictest20727-21apt-get07:30:373
1088399230,2cyclictest10794-21basename11:35:003
1088399230,0cyclictest19796-21apt-get09:40:383
10882992322,1cyclictest5543-21apt-get12:30:392
10882992320,2cyclictest27734-21apt07:45:002
10881992321,1cyclictest30519-21apt-get08:55:381
1088199230,22cyclictest28122-21apt-get08:50:371
1088199230,22cyclictest0-21swapper/109:10:371
10883992220,1cyclictest30519-21apt-get08:55:383
10883992220,1cyclictest0-21swapper/310:50:003
10883992220,1cyclictest0-21swapper/308:55:013
1088399220,21cyclictest27298-21apt-get09:55:023
1088399220,21cyclictest26250-21apt-get11:00:363
1088399220,21cyclictest18003-21cron07:25:003
1088399220,1cyclictest4621-21apt-get10:15:403
1088399220,1cyclictest19493-21perf09:40:013
1088399220,1cyclictest0-21swapper/312:05:013
1088399220,0cyclictest12895-21apt-get08:20:383
1088399220,0cyclictest0-21swapper/309:20:383
10882992221,0cyclictest0-21swapper/208:40:392
10882992220,1cyclictest32523-21cron07:55:012
10882992220,1cyclictest0-21swapper/212:25:392
1088299220,21cyclictest8391-21perf11:30:012
1088299220,21cyclictest2684-21munin-run09:05:002
1088299220,21cyclictest25502-21apt-get12:05:392
1088299220,21cyclictest25210-21munin-plugin-st12:05:012
1088299220,21cyclictest14966-21idleruntime-cro08:25:002
1088299220,21cyclictest0-21swapper/210:15:402
1088299220,1cyclictest685-21apt-get11:15:022
10881992222,0cyclictest0-21swapper/109:45:381
10881992221,1cyclictest26250-21apt-get11:00:371
10881992220,1cyclictest475-21apt-get09:00:381
10881992220,1cyclictest31040-21apt-get11:10:391
10881992220,1cyclictest27814-21cron08:50:011
1088199220,21cyclictest7037-21apt-get10:20:371
1088199220,21cyclictest32357-21cron12:20:001
1088199220,21cyclictest0-21swapper/109:15:391
1088199220,21cyclictest0-21swapper/107:39:391
1088199220,1cyclictest0-21swapper/109:40:371
1088199220,1cyclictest0-21swapper/108:05:361
1088199220,0cyclictest0-21swapper/107:30:371
10880992222,0cyclictest0-21swapper/010:20:370
10880992220,1cyclictest0-21swapper/011:45:400
1088099220,21cyclictest0-21swapper/008:35:010
1088099220,1cyclictest25211-21munin-run12:05:010
1088099220,1cyclictest22189-21apt-get09:45:380
1088099220,1cyclictest0-21swapper/010:25:400
10883992121,0cyclictest0-21swapper/309:30:383
10883992121,0cyclictest0-21swapper/309:00:383
10883992120,1cyclictest2973-21apt-get09:05:373
10883992120,1cyclictest0-21swapper/310:20:373
1088399210,20cyclictest23286-21apt-get08:40:393
1088399210,20cyclictest11122-21apt-get07:10:383
1088399210,20cyclictest0-21swapper/312:15:013
1088399210,1cyclictest0-21swapper/310:10:393
10882992121,0cyclictest0-21swapper/211:55:012
10882992121,0cyclictest0-21swapper/211:45:402
1088299210,20cyclictest0-21swapper/211:10:012
1088299210,20cyclictest0-21swapper/210:00:382
1088299210,1cyclictest32708-21apt-get12:20:382
1088299210,1cyclictest26660-21apt-get09:55:022
1088299210,0cyclictest0-21swapper/209:40:382
1088299210,0cyclictest0-21swapper/209:30:372
10881992121,0cyclictest0-21swapper/111:20:391
10881992121,0cyclictest0-21swapper/108:40:391
10881992120,0cyclictest0-21swapper/108:15:401
10881992119,1cyclictest25944-21turbostat11:00:001
10881992119,1cyclictest0-21swapper/112:00:011
1088199210,20cyclictest15291-21apt-get08:25:401
1088199210,20cyclictest0-21swapper/109:30:371
1088199210,0cyclictest0-21swapper/110:35:361
1088199210,0cyclictest0-21swapper/110:30:371
1088199210,0cyclictest0-21swapper/108:10:381
10880992121,0cyclictest0-21swapper/011:30:370
10880992120,1cyclictest5373-21apt-get09:10:370
10880992118,2cyclictest5373-21turbostat08:05:010
1088099210,21cyclictest0-21swapper/007:25:390
1088099210,20cyclictest20790-21apt-get08:35:020
1088099210,20cyclictest19044-21apt-get10:45:410
1088099210,20cyclictest0-21swapper/012:10:370
1088099210,0cyclictest685-21apt-get11:15:020
1088099210,0cyclictest0-21swapper/011:20:390
1088099210,0cyclictest0-21swapper/009:40:380
10883992020,0cyclictest0-21swapper/311:20:383
10883992020,0cyclictest0-21swapper/309:10:373
10883992019,1cyclictest0-21swapper/310:25:393
10883992019,0cyclictest0-21swapper/307:50:383
10883992018,1cyclictest27826-21turbostat08:50:013
1088399200,19cyclictest0-21swapper/312:30:393
10882992020,0cyclictest14228-21apt-get10:35:362
10882992020,0cyclictest0-21swapper/210:05:362
10882992020,0cyclictest0-21swapper/209:25:392
10882992020,0cyclictest0-21swapper/208:55:382
10882992020,0cyclictest0-21swapper/208:50:362
10882992017,2cyclictest10059-21idleruntime-cro12:40:012
1088299200,20cyclictest0-21swapper/210:10:392
1088299200,19cyclictest0-21swapper/207:10:382
1088299200,0cyclictest0-21swapper/210:45:402
1088299200,0cyclictest0-21swapper/208:30:372
10881992020,0cyclictest0-21swapper/111:15:021
10881992020,0cyclictest0-21swapper/109:35:381
10881992019,0cyclictest0-21swapper/107:20:361
10881992018,1cyclictest0-21swapper/109:30:011
1088199200,0cyclictest0-21swapper/112:30:391
1088199200,0cyclictest0-21swapper/111:30:371
1088199200,0cyclictest0-21swapper/107:50:371
10880992020,0cyclictest6291-21apt-get11:25:410
10880992020,0cyclictest0-21swapper/011:00:360
10880992020,0cyclictest0-21swapper/010:05:360
10880992020,0cyclictest0-21swapper/009:15:390
10880992020,0cyclictest0-21swapper/009:05:370
10880992020,0cyclictest0-21swapper/007:50:370
10880992019,0cyclictest14982-21apt-get09:30:370
10880992018,1cyclictest2446-21sh12:25:000
10880992018,1cyclictest10165-21perf08:15:000
1088099200,19cyclictest606-21dbus-daemon09:30:010
1088099200,0cyclictest0-21swapper/010:55:380
10883991919,0cyclictest29791-21apt-get10:00:383
10883991919,0cyclictest2450-21apt-get12:25:023
10883991919,0cyclictest20867-21apt-get08:35:373
10883991919,0cyclictest0-21swapper/311:40:383
10883991919,0cyclictest0-21swapper/310:30:373
10883991919,0cyclictest0-21swapper/309:50:383
10883991919,0cyclictest0-21swapper/308:30:023
10883991917,1cyclictest25926-21sendmail11:00:003
1088399190,18cyclictest0-21swapper/310:35:363
1088399190,0cyclictest0-21swapper/310:50:363
10882991919,0cyclictest15934-21apt-get07:20:362
10882991919,0cyclictest0-21swapper/210:20:372
10882991919,0cyclictest0-21swapper/208:35:372
10882991918,0cyclictest0-21swapper/211:40:382
10882991917,1cyclictest23835-21apt-get10:55:382
10882991917,1cyclictest18744-21basename10:45:002
10882991917,1cyclictest0-21swapper/211:25:012
10882991917,1cyclictest0-21swapper/210:30:012
1088299190,18cyclictest0-21swapper/209:45:382
10881991919,0cyclictest16649-21apt-get10:40:401
10881991919,0cyclictest10186-21apt-get09:20:381
10881991919,0cyclictest0-21swapper/112:25:021
10881991919,0cyclictest0-21swapper/111:30:011
10881991919,0cyclictest0-21swapper/108:35:371
10881991919,0cyclictest0-21swapper/107:25:391
10881991918,1cyclictest0-21swapper/112:10:371
10881991918,0cyclictest2225-21apt-get10:10:391
10881991917,1cyclictest26679-21awk09:55:001
10881991917,1cyclictest1-21systemd12:40:011
10881991916,2cyclictest13206-21sh07:15:011
10880991919,0cyclictest18294-21apt-get11:50:370
10880991919,0cyclictest0-21swapper/012:35:440
10880991919,0cyclictest0-21swapper/012:30:400
10880991919,0cyclictest0-21swapper/011:55:380
10880991919,0cyclictest0-21swapper/009:55:380
10880991919,0cyclictest0-21swapper/008:45:380
10880991919,0cyclictest0-21swapper/008:15:400
10883991818,0cyclictest20692-21apt-get11:55:383
10883991818,0cyclictest0-21swapper/312:20:393
10883991818,0cyclictest0-21swapper/309:25:383
10883991816,1cyclictest25644-21apt-get07:40:383
10882991818,0cyclictest0-21swapper/210:50:372
10882991818,0cyclictest0-21swapper/209:50:382
10882991818,0cyclictest0-21swapper/207:45:372
10882991818,0cyclictest0-21swapper/207:35:372
10882991818,0cyclictest0-21swapper/207:30:382
10882991817,0cyclictest5373-21apt-get09:10:372
10882991816,1cyclictest619-21polkitd08:15:002
10881991818,0cyclictest9433-21apt-get10:25:391
10881991817,1cyclictest0-21swapper/107:40:381
10880991818,0cyclictest0-21swapper/012:15:380
10880991818,0cyclictest0-21swapper/011:10:390
10880991818,0cyclictest0-21swapper/010:00:380
10880991818,0cyclictest0-21swapper/007:30:370
10880991817,1cyclictest13516-21apt-get07:15:370
1088099180,0cyclictest0-21swapper/012:05:390
10883991717,0cyclictest30288-21apt-get12:15:383
10883991717,0cyclictest10875-21cyclictest08:15:393
10883991717,0cyclictest0-21swapper/311:50:373
10883991717,0cyclictest0-21swapper/311:10:393
10883991717,0cyclictest0-21swapper/308:25:403
10883991717,0cyclictest0-21swapper/308:10:393
10883991717,0cyclictest0-21swapper/308:05:373
10883991717,0cyclictest0-21swapper/308:00:383
10883991717,0cyclictest0-21swapper/307:55:393
10883991714,2cyclictest13178-21idleruntime-cro11:40:003
10882991717,0cyclictest0-21swapper/212:15:382
10882991717,0cyclictest0-21swapper/209:05:372
10882991715,1cyclictest10470-21apt-get08:15:402
1088299170,1cyclictest0-21swapper/209:40:012
1088199173,13cyclictest28034-21apt-get07:45:361
10881991717,0cyclictest0-21swapper/109:05:371
10881991717,0cyclictest0-21swapper/108:20:381
10881991715,1cyclictest0-21swapper/108:05:011
10880991717,0cyclictest3142-21apt-get12:25:390
10880991717,0cyclictest0-21swapper/009:20:380
1088099170,8cyclictest0-21swapper/008:55:380
10883991616,0cyclictest32183-21apt-get10:05:363
10883991616,0cyclictest0-21swapper/311:05:383
10883991616,0cyclictest0-21swapper/309:15:393
10883991614,1cyclictest0-21swapper/307:30:003
10882991616,0cyclictest0-21swapper/211:35:402
10882991616,0cyclictest0-21swapper/211:00:372
10882991616,0cyclictest0-21swapper/209:15:392
10881991616,0cyclictest0-21swapper/112:00:401
10881991616,0cyclictest0-21swapper/111:35:391
10881991616,0cyclictest0-21swapper/107:15:381
10881991614,1cyclictest27602-21grep12:10:011
10881991613,2cyclictest2937-21cron08:00:011
1088199160,15cyclictest0-21swapper/110:20:011
10880991616,0cyclictest0-21swapper/011:40:370
10880991616,0cyclictest0-21swapper/007:35:370
1088099160,16cyclictest0-21swapper/008:40:390
10883991515,0cyclictest0-21swapper/312:35:443
10883991515,0cyclictest0-21swapper/307:45:373
1088399150,7cyclictest0-21swapper/309:45:383
10882991515,0cyclictest0-21swapper/209:20:382
10882991514,0cyclictest0-21swapper/207:55:022
10882991513,1cyclictest27893-21apt-get12:10:372
10882991513,1cyclictest0-21swapper/212:00:012
10880991515,0cyclictest0-21swapper/010:50:370
10880991515,0cyclictest0-21swapper/009:00:380
10880991515,0cyclictest0-21swapper/008:05:370
10880991513,1cyclictest4321-21latency_hist10:15:010
10880991513,1cyclictest0-21swapper/011:35:390
10883991413,0cyclictest0-21swapper/311:15:393
1088399140,14cyclictest0-21swapper/312:07:433
1088399140,14cyclictest0-21swapper/311:45:513
1088399140,14cyclictest0-21swapper/307:37:373
1088399140,14cyclictest0-21swapper/307:16:403
1088399140,0cyclictest0-21swapper/311:25:543
1088399140,0cyclictest0-21swapper/310:40:113
1088299140,14cyclictest0-21swapper/208:26:002
1088299140,14cyclictest0-21swapper/208:05:052
1088299140,14cyclictest0-21swapper/207:26:012
1088299140,14cyclictest0-21swapper/207:16:222
1088299140,0cyclictest0-21swapper/211:31:242
1088299140,0cyclictest0-21swapper/211:10:102
1088299140,0cyclictest0-21swapper/208:45:222
1088299140,0cyclictest0-21swapper/208:01:452
10881991414,0cyclictest0-21swapper/110:46:321
1088199140,14cyclictest0-21swapper/111:40:261
1088199140,14cyclictest0-21swapper/111:05:161
1088199140,14cyclictest0-21swapper/110:00:251
1088199140,0cyclictest0-21swapper/112:20:111
1088199140,0cyclictest0-21swapper/110:50:181
10880991414,0cyclictest0-21swapper/011:05:060
10880991414,0cyclictest0-21swapper/010:15:110
10880991414,0cyclictest0-21swapper/009:50:540
10880991414,0cyclictest0-21swapper/008:25:400
10880991414,0cyclictest0-21swapper/007:55:490
1088099140,14cyclictest0-21swapper/010:35:370
1088099140,14cyclictest0-21swapper/009:35:280
1088099140,14cyclictest0-21swapper/007:40:070
1088099140,14cyclictest0-21swapper/007:20:220
1088099140,0cyclictest0-21swapper/010:40:250
1088099140,0cyclictest0-21swapper/008:20:080
1088099140,0cyclictest0-21swapper/007:12:160
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional