You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-21 - 16:09

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #2, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack2slot7s.osadl.org (updated Tue Jul 21, 2026 12:43:13)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
108046099544,37cyclictest1207532-21ssh11:40:472
1080459995431,20cyclictest1221365-21munin-plugin-st12:05:001
1080459995037,7cyclictest0-21swapper/111:00:491
108046099495,33cyclictest1213561-21ssh11:50:492
1080459994939,6cyclictest1173581-21systemd-run10:45:011
1080459994922,23cyclictest1-21systemd12:35:341
1080459994622,4cyclictest1134597-21/usr/sbin/munin09:40:011
1080460994538,4cyclictest1119515-21kworker/u8:6+xprtiod10:15:422
1080460994538,4cyclictest1119515-21kworker/u8:6+xprtiod10:15:422
1080459994539,3cyclictest0-21swapper/111:50:401
1080459994521,4cyclictest1218346-21sendmail12:00:011
1080459994521,4cyclictest1218346-21sendmail12:00:011
1080459994517,5cyclictest421-21dbus-daemon08:15:021
1080459994517,5cyclictest1089481-21systemd-run07:40:011
1080458994537,5cyclictest485-21in:imuxsock09:55:010
1080460994436,5cyclictest485-21in:imuxsock08:35:402
1080460994430,10cyclictest439-21systemd-logind07:45:022
108045999441,37cyclictest1228532-21ssh12:15:491
1080458994436,5cyclictest420-21avahi-daemon09:43:250
1080460994335,5cyclictest1123581-21needreboot09:20:422
108045999435,11cyclictest1198664-21ssh11:25:531
1080459994317,6cyclictest0-21swapper/109:25:471
108045999423,28cyclictest1165784-21ssh10:30:501
1080459994221,2cyclictest0-21swapper/110:20:511
1080459994221,2cyclictest0-21swapper/110:20:511
1080458994235,5cyclictest1219135-21sshd12:00:390
1080458994233,6cyclictest1094089-21latency_hist07:55:020
108045899423,31cyclictest1147682-21ssh10:00:440
1080460994132,6cyclictest421-21dbus-daemon11:40:022
1080460994132,6cyclictest1159942-21mailstats10:20:512
1080460994132,6cyclictest1159942-21mailstats10:20:512
1080460994132,5cyclictest1147946-21mailstats10:00:522
1080459994133,5cyclictest1150785-21ssh10:05:481
1080459994123,2cyclictest0-21swapper/109:45:011
1080459994120,3cyclictest1002-21mta-sts-daemon07:40:421
1080459994120,3cyclictest1001-21mta-sts-daemon11:14:401
108045899413,32cyclictest1204655-21ssh11:35:570
1080458994131,4cyclictest1102948-21cron08:25:010
1080459994031,6cyclictest1141622-21needreboot09:50:421
1080459994031,5cyclictest1116447-21diskmemload10:00:521
108045999401,28cyclictest1201552-21ssh11:30:461
1080458994033,4cyclictest1211111-21head11:46:020
1080458994032,5cyclictest420-21avahi-daemon09:14:040
1080460993932,3cyclictest1110438-21kworker/u8:2+nfsiod08:55:012
1080460993932,3cyclictest0-21swapper/210:05:522
1080460993931,5cyclictest1-21systemd09:00:012
1080460993931,5cyclictest1081956-21systemd-run07:15:012
108045999393,29cyclictest1144797-21ssh09:55:501
1080458993933,4cyclictest1194494-21idleruntime-cro11:20:010
108045899392,16cyclictest1231428-21modprobe12:20:430
1080460993829,6cyclictest1182539-21sendmail11:00:012
1080460993828,6cyclictest485-21in:imuxsock07:55:012
108046099382,29cyclictest1231435-21ssh12:20:432
108045999381,31cyclictest665-21snmpd10:55:411
1080458993832,2cyclictest0-21swapper/007:15:010
1080458993827,8cyclictest1089432-21idleruntime-cro07:40:010
1080458993826,9cyclictest277787-21cups-browsed12:19:320
1080458993820,15cyclictest1104976-21fschecks_time08:30:390
1080460993729,5cyclictest1177812-21rm10:50:512
1080460993729,5cyclictest1132317-21gltestperf09:35:362
108046099371,29cyclictest1116447-21diskmemload10:25:442
1080458993730,4cyclictest1184266-21sed11:01:000
1080458993729,5cyclictest1003-21mta-sts-daemon12:36:530
1080458993725,9cyclictest1003-21mta-sts-daemon10:20:430
1080458993725,9cyclictest1003-21mta-sts-daemon10:20:430
1080458993725,10cyclictest12650irq/32-eth011:05:520
1080460993628,5cyclictest1095446-21basename08:00:002
1080460993628,5cyclictest1095446-21basename08:00:002
1080460993625,7cyclictest1-21systemd09:30:012
1080459993628,5cyclictest1140640-21systemd-run09:50:011
1080459993625,8cyclictest1087944-21munin-plugin-st07:35:011
1080459993618,14cyclictest441-21thd09:15:521
1080458993630,4cyclictest1113306-21tail08:55:560
1080458993627,6cyclictest421-21dbus-daemon09:46:210
108045899362,26cyclictest1216487-21ssh11:55:470
108045899362,26cyclictest1216487-21ssh11:55:470
1080458993620,11cyclictest421-21dbus-daemon09:35:430
1080458993616,14cyclictest12650irq/32-eth010:55:500
1080460993528,4cyclictest1188513-21ls11:10:012
1080460993528,4cyclictest1176546-21grep10:50:012
1080459993528,4cyclictest1095971-21fschecks_count08:00:381
1080459993526,6cyclictest1129044-21aten_r2power_en09:30:341
1080459993525,6cyclictest1207072-21/usr/sbin/munin11:40:381
1080458993529,3cyclictest0-21swapper/010:30:460
1080458993529,2cyclictest0-21swapper/012:25:520
1080458993528,5cyclictest277787-21cups-browsed09:01:030
1080458993528,5cyclictest277787-21cups-browsed09:01:030
1080458993527,5cyclictest1-21systemd10:00:020
1080460993426,5cyclictest277787-21cups-browsed08:07:162
1080460993425,7cyclictest1087251-21needreboot07:30:432
1080460993425,5cyclictest1230344-21munin-run12:20:012
1080459993424,6cyclictest1174553-21needreboot10:45:391
1080458993427,4cyclictest1200638-21latency_hist11:30:030
1080458993427,4cyclictest1122545-21cron09:20:010
1080460993328,2cyclictest0-21swapper/208:00:402
1080460993327,3cyclictest0-21swapper/212:10:012
1080460993327,3cyclictest0-21swapper/210:10:432
1080460993322,8cyclictest1138880-21/usr/sbin/munin09:45:522
1080459993326,3cyclictest1234243-21kworker/u8:7-rpciod12:30:011
1080459993324,5cyclictest1-21systemd07:15:021
1080459993324,4cyclictest0-21swapper/107:25:491
1080458993328,3cyclictest1110420-21kworker/u8:0-rpciod09:10:000
1080458993326,4cyclictest420-21avahi-daemon10:50:530
1080458993326,4cyclictest1110345-21unixbench_multi08:45:580
1080458993323,7cyclictest0-21swapper/011:55:010
1080460993225,4cyclictest1242333-21munin-run12:40:012
1080460993224,5cyclictest1167583-21systemd-run10:35:012
1080459993226,3cyclictest1003-21mta-sts-daemon11:21:441
1080459993226,3cyclictest0-21swapper/110:25:401
1080459993226,3cyclictest0-21swapper/110:20:001
1080459993226,3cyclictest0-21swapper/110:20:001
1080459993226,3cyclictest0-21swapper/110:15:031
1080459993224,5cyclictest1204153-21fschecks_time11:35:411
1080459993224,5cyclictest1177814-21proc_pri10:50:511
1080459993224,5cyclictest1101013-21systemctl08:15:521
1080459993223,6cyclictest421-21dbus-daemon08:35:011
108045899326,18cyclictest1174672-21ssh10:45:440
108045899326,16cyclictest151ktimers/012:05:490
1080458993225,4cyclictest1000-21mta-sts-daemon10:15:010
1080458993224,5cyclictest439-21systemd-logind07:35:010
1080458993223,6cyclictest1170951-21/usr/sbin/munin10:40:540
1080458993220,9cyclictest0-21swapper/010:15:420
1080458993220,9cyclictest0-21swapper/010:15:420
1080458993213,7cyclictest265-21systemd-journal08:05:020
1080458993212,14cyclictest1123675-21ssh09:20:450
1080460993126,2cyclictest0-21swapper/211:35:012
1080460993125,3cyclictest0-21swapper/212:00:412
1080460993124,3cyclictest0-21swapper/212:25:512
1080460993124,3cyclictest0-21swapper/209:50:472
1080460993124,3cyclictest0-21swapper/209:10:462
1080460993123,5cyclictest265-21systemd-journal10:45:012
1080460993123,4cyclictest0-21swapper/211:30:022
1080460993122,6cyclictest1121232-21grep09:15:592
1080460993122,5cyclictest1170549-21sendmail10:40:002
1080460993117,3cyclictest171rcu_preempt09:55:092
1080459993124,3cyclictest0-21swapper/109:10:501
1080459993123,5cyclictest1084560-21systemctl07:20:531
1080459993123,5cyclictest1001-21mta-sts-daemon07:55:451
1080459993123,5cyclictest1001-21mta-sts-daemon07:55:451
1080459993122,5cyclictest0-21swapper/111:05:491
1080459993121,6cyclictest1107479-21systemd-run08:40:011
1080459993120,7cyclictest0-21swapper/110:40:021
1080458993124,3cyclictest151ktimers/011:20:490
108045899312,23cyclictest1201559-21ntpq11:30:470
1080458993121,8cyclictest1091848-21ntp_kernel_pll_07:45:460
1080458993121,6cyclictest0-21swapper/012:10:570
1080458993121,4cyclictest1000-21mta-sts-daemon08:20:020
1080458993119,8cyclictest421-21dbus-daemon10:36:270
1080460993023,4cyclictest1102882-21unixbench_singl08:21:012
1080460993023,4cyclictest1083487-21systemd07:20:022
1080460993023,4cyclictest1000-21mta-sts-daemon09:30:362
1080460993023,3cyclictest0-21swapper/211:00:412
1080460993022,5cyclictest1109478-21fschecks_time08:45:392
1080460993022,5cyclictest1083971-21fschecks_count07:20:372
1080460993022,5cyclictest1001-21mta-sts-daemon09:40:362
1080460993022,5cyclictest0-21swapper/211:25:022
1080460993021,5cyclictest428-21mta-sts-daemon08:15:332
1080460993019,8cyclictest1114971-21systemd-run09:05:012
1080460993019,8cyclictest1114971-21systemd-run09:05:012
1080459993025,2cyclictest0-21swapper/107:20:011
1080459993022,5cyclictest1193190-21head11:15:571
1080458993025,2cyclictest0-21swapper/011:40:470
1080458993024,4cyclictest1239394-21latency_hist12:35:020
1080458993022,6cyclictest0-21swapper/010:25:570
1080460992920,6cyclictest1226034-21unixbench_multi12:10:582
1080459992922,3cyclictest0-21swapper/112:05:391
1080459992921,5cyclictest1225376-21needreboot12:10:431
1080459992919,5cyclictest271ktimers/112:20:421
108045999291,23cyclictest1210570-21ssh11:45:511
1080458992914,12cyclictest151ktimers/008:35:440
1080458992912,11cyclictest1126891-21ps09:25:520
1080460992822,3cyclictest0-21swapper/212:30:412
1080460992822,3cyclictest0-21swapper/212:00:012
1080460992822,3cyclictest0-21swapper/212:00:012
1080460992821,4cyclictest1089438-21munin-run07:40:012
1080460992821,3cyclictest0-21swapper/211:10:532
1080459992821,3cyclictest0-21swapper/109:25:011
1080459992820,5cyclictest1104355-21unixbench_multi08:25:571
1080458992824,2cyclictest0-21swapper/009:35:010
1080460992721,3cyclictest0-21swapper/209:10:002
1080460992720,3cyclictest0-21swapper/211:15:452
1080459992721,3cyclictest0-21swapper/112:30:471
1080459992720,4cyclictest1113425-21cron09:00:001
1080459992719,5cyclictest1092394-21head07:45:561
108045899275,16cyclictest1003-21mta-sts-daemon07:20:450
1080458992721,4cyclictest1108972-21systemd-run08:45:010
1080458992712,10cyclictest1150846-21ssh10:05:510
1080458992711,13cyclictest151ktimers/007:25:500
1080460992620,2cyclictest0-21swapper/211:45:502
1080459992618,5cyclictest1114946-21cron09:05:001
1080459992618,5cyclictest1114946-21cron09:05:001
108045899262,19cyclictest1191483-21cron11:15:010
1080458992619,5cyclictest1002-21mta-sts-daemon07:40:430
1080460992515,7cyclictest694-21cron07:30:012
108046099251,19cyclictest665-21snmpd08:25:512
1080459992518,4cyclictest1003-21mta-sts-daemon08:20:381
108045899252,17cyclictest1094536-21if_wlan007:55:400
108045899252,17cyclictest1094536-21if_wlan007:55:400
1080458992520,2cyclictest0-21swapper/008:30:020
1080460992418,3cyclictest0-21swapper/208:10:482
1080460992417,5cyclictest0-21swapper/207:45:422
108045999247,12cyclictest277787-21cups-browsed07:50:431
1080458992418,4cyclictest1097627-21latency08:05:420
1080458992416,6cyclictest1099090-21kernelversion08:10:390
1080458992411,10cyclictest0-21swapper/008:50:540
1080460992317,3cyclictest1001-21mta-sts-daemon07:10:022
1080459992318,3cyclictest1001-21mta-sts-daemon08:40:481
108045899234,14cyclictest151ktimers/007:15:440
1080458992310,10cyclictest0-21swapper/007:10:030
1080460992217,2cyclictest0-21swapper/208:40:572
1080459992217,3cyclictest0-21swapper/109:05:401
1080459992216,3cyclictest0-21swapper/108:45:581
1080459992211,8cyclictest265-21systemd-journal08:50:401
108046199214,9cyclictest0-21swapper/307:50:433
1080460992115,3cyclictest0-21swapper/208:30:472
1080459992113,5cyclictest1097469-21fschecks_count08:05:391
108046199203,11cyclictest0-21swapper/309:20:453
108046199203,10cyclictest0-21swapper/307:30:483
1080459992012,5cyclictest1-21systemd07:10:021
108046199193,9cyclictest0-21swapper/312:20:403
108046199193,9cyclictest0-21swapper/310:30:463
108046199192,7cyclictest0-21swapper/307:25:533
108046199192,11cyclictest0-21swapper/311:40:583
108046199192,10cyclictest0-21swapper/311:20:493
108046199192,10cyclictest0-21swapper/311:10:493
108046199192,10cyclictest0-21swapper/309:45:443
108046199192,10cyclictest0-21swapper/309:35:423
108046199191,11cyclictest0-21swapper/309:50:463
108046199183,9cyclictest0-21swapper/311:45:533
108046199183,9cyclictest0-21swapper/310:20:473
108046199183,9cyclictest0-21swapper/310:20:473
108046199183,9cyclictest0-21swapper/309:55:453
108046199183,8cyclictest0-21swapper/311:30:463
108046199182,9cyclictest0-21swapper/311:25:463
108046199182,9cyclictest0-21swapper/309:30:453
108046199182,10cyclictest0-21swapper/310:45:333
108046199181,10cyclictest0-21swapper/311:15:463
108046199181,10cyclictest0-21swapper/311:00:493
108046199174,8cyclictest0-21swapper/312:05:343
108046199174,7cyclictest0-21swapper/311:50:453
108046199173,9cyclictest0-21swapper/309:10:373
108046199173,8cyclictest0-21swapper/311:55:453
108046199173,8cyclictest0-21swapper/311:55:453
108046199173,8cyclictest0-21swapper/310:00:473
108046199173,7cyclictest0-21swapper/312:00:383
108046199172,9cyclictest0-21swapper/312:15:443
108046199172,9cyclictest0-21swapper/310:55:453
108046199172,9cyclictest0-21swapper/309:25:433
108046199172,10cyclictest0-21swapper/312:10:393
108046199172,10cyclictest0-21swapper/310:50:443
108046199172,10cyclictest0-21swapper/310:40:413
108046199171,9cyclictest0-21swapper/309:40:343
108046199164,7cyclictest0-21swapper/310:15:443
108046199164,7cyclictest0-21swapper/310:15:443
108046199164,7cyclictest0-21swapper/310:05:453
108046199163,7cyclictest0-21swapper/310:35:373
108046199162,9cyclictest0-21swapper/312:35:463
108046199162,9cyclictest0-21swapper/310:25:403
108046199162,8cyclictest0-21swapper/312:30:353
108046199162,8cyclictest0-21swapper/309:15:503
108046199162,7cyclictest0-21swapper/307:20:463
108046199162,7cyclictest0-21swapper/307:20:013
108046199162,6cyclictest0-21swapper/307:40:473
108046199161,9cyclictest0-21swapper/311:36:013
108046199161,7cyclictest0-21swapper/308:50:443
108046199161,6cyclictest0-21swapper/309:05:423
108046199152,7cyclictest0-21swapper/308:45:013
108046199152,7cyclictest0-21swapper/307:40:013
108046199151,9cyclictest0-21swapper/312:26:403
108046199151,8cyclictest0-21swapper/308:35:503
108046199151,7cyclictest0-21swapper/308:15:483
108046199151,6cyclictest0-21swapper/308:10:443
108046199143,6cyclictest0-21swapper/308:05:483
108046199143,5cyclictest0-21swapper/308:45:483
108046199142,8cyclictest0-21swapper/309:00:453
108046199142,8cyclictest0-21swapper/309:00:453
108046199142,8cyclictest0-21swapper/308:00:013
108046199142,8cyclictest0-21swapper/308:00:013
108046199142,7cyclictest0-21swapper/310:10:373
108046199142,7cyclictest0-21swapper/308:25:403
108046199141,9cyclictest0-21swapper/308:35:013
108046199141,7cyclictest0-21swapper/307:10:483
108046199133,7cyclictest0-21swapper/311:08:443
108046199131,8cyclictest0-21swapper/308:55:433
108046199131,8cyclictest0-21swapper/307:45:473
108046199131,6cyclictest0-21swapper/308:00:443
108046199101,6cyclictest0-21swapper/308:20:393
10804619991,6cyclictest0-21swapper/307:10:013
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional