You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-19 - 20:00

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Fri Dec 19, 2025 12:44:21)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
28864992525,0cyclictest0-21swapper/107:39:451
2887199240,23cyclictest606-21dbus-daemon08:25:013
2886899240,23cyclictest0-21swapper/212:19:462
2886199240,2cyclictest29511-21latency_hist10:30:000
2886199240,23cyclictest12533-21apt-get11:04:480
28871992320,2cyclictest13560-21munin-run12:10:003
2887199230,22cyclictest13786-21latency_hist08:50:003
2887199230,22cyclictest0-21swapper/307:29:453
28868992320,2cyclictest24618-21sh10:20:002
28868992320,2cyclictest14289-21turbostat11:05:002
28864992322,1cyclictest0-21swapper/110:30:021
2886499231,21cyclictest21962-21apt-get08:00:021
2886499230,22cyclictest0-21swapper/107:30:021
28861992321,1cyclictest0-21swapper/012:24:470
2886199230,22cyclictest21462-21cron11:20:000
2886199230,1cyclictest26175-21apt-get12:39:480
28871992221,1cyclictest459-21apt-get10:39:473
28871992221,1cyclictest22858-21apt-get10:19:453
28871992220,1cyclictest9464-21cron10:55:013
28871992220,1cyclictest313-21systemd-journal08:15:013
28871992220,1cyclictest11161-21perf12:05:003
2887199220,21cyclictest3605-21cron07:25:013
28868992221,1cyclictest0-21swapper/209:24:482
28868992220,1cyclictest1534-21awk11:45:012
2886899221,20cyclictest27673-21apt-get10:29:472
2886899220,21cyclictest5321-21apt-get10:49:462
2886899220,21cyclictest29148-21turbostat11:35:012
2886899220,21cyclictest19711-21apt-get11:19:462
2886899220,21cyclictest18988-21apt-get12:24:472
2886899220,21cyclictest0-21swapper/208:04:472
2886899220,21cyclictest0-21swapper/207:35:012
2886899220,1cyclictest4576-21apt-get11:54:462
28864992221,1cyclictest11964-21apt-get07:44:461
28864992221,0cyclictest0-21swapper/109:04:471
28864992220,1cyclictest16569-21apt-get12:19:461
28864992220,1cyclictest0-21swapper/112:15:001
2886499220,1cyclictest459-21apt-get10:39:471
28861992222,0cyclictest0-21swapper/008:09:460
28861992220,1cyclictest1352-21idleruntime-cro08:25:010
28861992220,1cyclictest0-21swapper/010:44:470
28861992220,1cyclictest0-21swapper/010:00:010
28861992220,1cyclictest0-21swapper/007:29:450
2886199220,21cyclictest29779-21apt-get11:39:470
2886199220,21cyclictest21606-21apt-get09:09:460
2886199220,21cyclictest16174-21grep08:55:010
2886199220,21cyclictest10865-21apt-get09:54:460
2886199220,21cyclictest0-21swapper/012:04:470
2886199220,21cyclictest0-21swapper/011:35:010
2886199220,21cyclictest0-21swapper/007:44:460
28871992120,1cyclictest6074-21apt-get09:44:453
28871992120,1cyclictest0-21swapper/310:59:463
2887199210,21cyclictest0-21swapper/311:29:473
2887199210,20cyclictest0-21swapper/307:54:473
2887199210,1cyclictest20766-21munin-run12:25:013
2887199210,1cyclictest0-21swapper/309:59:463
2887199210,0cyclictest0-21swapper/310:24:463
28868992120,1cyclictest0-21swapper/209:54:462
28868992119,1cyclictest7849-21dump-pmu-power09:45:002
28868992119,1cyclictest28992-21munin-plugin-st08:15:012
28868992119,1cyclictest19213-21apt-get09:04:472
28868992119,1cyclictest0-21swapper/211:40:012
28868992119,1cyclictest0-21swapper/210:40:012
2886899210,20cyclictest2182-21apt-get11:49:472
2886899210,20cyclictest0-21swapper/212:09:452
2886899210,1cyclictest23073-21sed12:29:562
2886899210,0cyclictest4256-21apt-get07:29:452
28864992120,1cyclictest0-21swapper/111:59:471
28864992120,0cyclictest27321-21apt-get11:34:471
28864992119,1cyclictest29503-21perf10:30:001
28864992116,4cyclictest18925-21awk07:55:001
2886499210,0cyclictest0-21swapper/111:24:481
2886499210,0cyclictest0-21swapper/111:09:481
2886499210,0cyclictest0-21swapper/108:59:451
28861992121,0cyclictest0-21swapper/008:39:470
28861992120,1cyclictest23781-21apt-get12:34:470
28861992120,1cyclictest2006-21apt-get08:29:460
28861992120,1cyclictest16793-21apt-get08:59:460
2886199210,21cyclictest0-21swapper/011:44:470
2886199210,20cyclictest11778-21apt-get12:09:450
2886199210,20cyclictest0-21swapper/008:19:460
28871992020,0cyclictest0-21swapper/312:29:473
28871992020,0cyclictest0-21swapper/311:14:493
28871992020,0cyclictest0-21swapper/310:29:473
28871992020,0cyclictest0-21swapper/309:39:453
28871992020,0cyclictest0-21swapper/308:09:463
28871992020,0cyclictest0-21swapper/307:49:463
28871992019,1cyclictest0-21swapper/309:04:473
28871992019,0cyclictest19542-21apt-get07:59:443
2887199200,1cyclictest0-21swapper/310:14:563
2887199200,0cyclictest22132-21apt-get11:24:483
2887199200,0cyclictest0-21swapper/309:29:483
2887199200,0cyclictest0-21swapper/309:24:483
28868992020,0cyclictest29458-21apt-get07:14:442
28868992020,0cyclictest0-21swapper/211:24:482
28868992020,0cyclictest0-21swapper/208:39:472
28868992020,0cyclictest0-21swapper/208:34:472
28868992020,0cyclictest0-21swapper/208:19:462
28868992020,0cyclictest0-21swapper/207:59:442
28868992020,0cyclictest0-21swapper/207:50:022
28868992020,0cyclictest0-21swapper/207:49:462
28868992019,0cyclictest0-21swapper/210:54:482
28868992018,1cyclictest2931-21apt-get10:44:472
2886899200,20cyclictest0-21swapper/211:25:022
2886899200,0cyclictest0-21swapper/209:29:482
2886899200,0cyclictest0-21swapper/208:54:472
28864992020,0cyclictest31856-21apt-get07:19:471
28864992020,0cyclictest0-21swapper/111:49:471
28864992020,0cyclictest0-21swapper/110:19:461
28864992020,0cyclictest0-21swapper/108:49:461
28864992020,0cyclictest0-21swapper/107:49:461
28864992018,1cyclictest26407-21apt-get09:19:471
28864992018,1cyclictest14292-21awk11:05:001
2886499200,0cyclictest0-21swapper/108:14:451
28861992020,0cyclictest0-21swapper/010:39:470
28861992020,0cyclictest0-21swapper/008:34:470
28861992020,0cyclictest0-21swapper/007:59:440
28861992019,1cyclictest28886-21apt-get09:24:480
2886199200,19cyclictest0-21swapper/007:40:010
28871991919,0cyclictest4409-21apt-get08:34:473
28871991919,0cyclictest0-21swapper/312:14:473
28871991919,0cyclictest0-21swapper/311:19:473
28871991919,0cyclictest0-21swapper/310:44:473
28871991919,0cyclictest0-21swapper/310:09:463
28871991919,0cyclictest0-21swapper/309:14:443
28871991919,0cyclictest0-21swapper/309:09:463
28871991919,0cyclictest0-21swapper/309:00:013
28871991919,0cyclictest0-21swapper/308:39:473
28871991918,0cyclictest30526-21apt-get10:34:463
28871991918,0cyclictest0-21swapper/308:54:473
28868991919,0cyclictest0-21swapper/211:09:482
28868991919,0cyclictest0-21swapper/209:34:452
28868991919,0cyclictest0-21swapper/209:19:472
28868991919,0cyclictest0-21swapper/208:40:022
28868991917,1cyclictest17461-21munin-plugin-st10:05:012
2886899190,19cyclictest0-21swapper/209:59:462
28864991919,0cyclictest15674-21apt-get10:04:471
28864991919,0cyclictest0-21swapper/109:49:461
28864991919,0cyclictest0-21swapper/109:44:451
28864991919,0cyclictest0-21swapper/109:39:451
28864991919,0cyclictest0-21swapper/109:34:451
28864991919,0cyclictest0-21swapper/108:54:471
28864991919,0cyclictest0-21swapper/108:29:461
28864991918,0cyclictest0-21swapper/107:29:451
28864991917,1cyclictest593-21perf09:30:001
2886499190,18cyclictest10110-21apt-get10:59:461
2886499190,18cyclictest0-21swapper/110:14:461
28861991919,0cyclictest5321-21apt-get10:49:460
28861991919,0cyclictest31278-21apt-get09:29:470
28861991919,0cyclictest25279-21apt-get10:24:460
28861991919,0cyclictest1864-21apt-get07:24:470
28861991919,0cyclictest18070-21apt-get10:09:460
28861991919,0cyclictest0-21swapper/011:14:480
28861991919,0cyclictest0-21swapper/010:34:460
28861991919,0cyclictest0-21swapper/010:19:460
28861991919,0cyclictest0-21swapper/007:54:470
28861991918,1cyclictest13784-21idleruntime-cro08:50:000
28861991918,1cyclictest0-21swapper/011:24:480
28861991916,2cyclictest28965-21ls08:15:010
28861991916,2cyclictest1-21systemd10:55:010
2886199190,19cyclictest0-21swapper/011:09:480
28871991818,0cyclictest0-21swapper/312:19:463
28871991818,0cyclictest0-21swapper/311:49:473
28871991818,0cyclictest0-21swapper/311:39:483
28871991818,0cyclictest0-21swapper/308:29:453
28871991816,1cyclictest0-21swapper/312:40:013
28868991818,0cyclictest18070-21apt-get10:09:472
28868991818,0cyclictest0-21swapper/210:24:462
28868991818,0cyclictest0-21swapper/208:09:452
28868991816,1cyclictest10255-21munin-run09:50:012
2886899180,1cyclictest14176-21apt-get12:14:472
28864991818,0cyclictest13257-21apt-get09:59:461
28864991818,0cyclictest0-21swapper/112:34:471
28864991818,0cyclictest0-21swapper/111:29:461
28864991818,0cyclictest0-21swapper/111:14:481
28864991818,0cyclictest0-21swapper/110:24:461
28864991818,0cyclictest0-21swapper/110:09:471
28864991818,0cyclictest0-21swapper/109:24:481
28861991818,0cyclictest0-21swapper/011:54:460
28861991818,0cyclictest0-21swapper/011:49:470
28861991818,0cyclictest0-21swapper/011:29:470
28861991818,0cyclictest0-21swapper/010:04:460
28871991717,0cyclictest31856-21apt-get07:19:463
28871991717,0cyclictest0-21swapper/311:44:473
28871991717,0cyclictest0-21swapper/310:49:453
28871991717,0cyclictest0-21swapper/309:54:463
28871991717,0cyclictest0-21swapper/307:45:003
28871991717,0cyclictest0-21swapper/307:30:023
28871991717,0cyclictest0-21swapper/307:14:453
28868991717,0cyclictest0-21swapper/208:25:012
28868991716,1cyclictest0-21swapper/211:59:462
28868991716,0cyclictest0-21swapper/212:39:482
28864991717,0cyclictest0-21swapper/108:09:451
28864991717,0cyclictest0-21swapper/107:59:441
28864991715,1cyclictest9473-21apt10:55:011
28864991715,1cyclictest1-21systemd08:25:011
28864991714,2cyclictest4696-21perf10:45:011
28861991717,0cyclictest0-21swapper/012:29:470
28861991717,0cyclictest0-21swapper/010:14:560
28861991716,1cyclictest0-21swapper/009:39:450
2886199170,16cyclictest21315-21apt-get08:00:020
28871991616,0cyclictest29153-21perf11:35:013
28871991616,0cyclictest0-21swapper/308:04:473
28871991614,1cyclictest0-21swapper/311:04:583
28871991613,2cyclictest0-21swapper/309:35:003
28868991616,0cyclictest16793-21apt-get08:59:452
28868991614,1cyclictest0-21swapper/207:19:552
2886899160,2cyclictest151rcu_preempt10:34:522
28864991616,0cyclictest0-21swapper/108:44:461
28864991615,0cyclictest0-21swapper/111:44:461
28861991616,0cyclictest14358-21apt-get07:49:460
28861991616,0cyclictest0-21swapper/009:44:450
28861991615,1cyclictest0-21swapper/012:14:470
28861991613,3cyclictest10408-21munin-node09:10:050
2886199160,15cyclictest0-21swapper/008:44:460
2886199160,15cyclictest0-21swapper/007:19:490
28871991515,0cyclictest0-21swapper/312:34:473
28871991515,0cyclictest0-21swapper/311:09:483
28871991515,0cyclictest0-21swapper/309:19:473
28871991514,1cyclictest6969-21apt-get11:59:463
28871991513,1cyclictest0-21swapper/310:04:473
28871991513,1cyclictest0-21swapper/307:39:523
28868991515,0cyclictest0-21swapper/212:04:472
28868991513,1cyclictest25776-21sh09:15:012
28868991513,1cyclictest23390-21sleep09:10:012
2886899150,11cyclictest619-21polkitd07:45:002
2886499156,8cyclictest313-21systemd-journal09:50:461
28864991513,1cyclictest8565-21dump-pmu-power08:40:001
28861991515,0cyclictest0-21swapper/010:59:460
28861991514,1cyclictest0-21swapper/009:04:470
28871991414,0cyclictest0-21swapper/308:40:023
2887199140,14cyclictest0-21swapper/309:45:123
2887199140,14cyclictest0-21swapper/308:15:123
2887199140,0cyclictest0-21swapper/311:50:493
28868991414,0cyclictest0-21swapper/211:10:112
28868991414,0cyclictest0-21swapper/208:25:522
28868991414,0cyclictest0-21swapper/207:22:432
2886899140,14cyclictest0-21swapper/212:30:192
2886899140,14cyclictest0-21swapper/209:36:232
2886899140,14cyclictest0-21swapper/208:45:362
2886899140,0cyclictest0-21swapper/207:35:582
28864991414,0cyclictest0-21swapper/112:26:021
28864991414,0cyclictest0-21swapper/111:35:081
28864991414,0cyclictest0-21swapper/109:11:081
28864991414,0cyclictest0-21swapper/109:05:131
2886499140,14cyclictest0-21swapper/112:35:151
2886499140,14cyclictest0-21swapper/108:15:241
2886499140,0cyclictest0-21swapper/112:20:291
2886499140,0cyclictest0-21swapper/111:16:561
2886499140,0cyclictest0-21swapper/107:20:081
28861991414,0cyclictest0-21swapper/012:15:050
28861991414,0cyclictest0-21swapper/011:55:100
2886199140,14cyclictest0-21swapper/009:15:010
2886199140,14cyclictest0-21swapper/007:30:140
2886199140,14cyclictest0-21swapper/007:10:540
2886199140,0cyclictest0-21swapper/009:45:290
2886199140,0cyclictest0-21swapper/009:30:540
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional