You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-13 - 13:05

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #2, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack2slot7s.osadl.org (updated Sat Dec 13, 2025 01:54:19)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
963034997038,28cyclictest1086752-21ssh22:54:420
963034997038,28cyclictest1086752-21ssh22:54:420
963034996254,4cyclictest1001680-21ssh21:14:350
963034996254,4cyclictest1001680-21ssh21:14:350
96303599606,43cyclictest1090937-21ssh22:59:381
96303599606,43cyclictest1090937-21ssh22:59:381
963035995645,6cyclictest0-21swapper/122:54:411
963035995645,6cyclictest0-21swapper/122:54:411
963034995336,13cyclictest1028640-21latency_hist21:45:020
963034995231,14cyclictest12450irq/32-eth022:49:360
963034995229,16cyclictest12450irq/32-eth023:34:370
963036994840,5cyclictest812-21cron22:40:002
963036994726,14cyclictest735-21lldpd20:49:362
963035994736,7cyclictest971785-21grep19:40:001
96303499474,37cyclictest1039128-21ssh21:59:380
963035994637,6cyclictest564-21dbus-daemon21:35:011
963035994637,6cyclictest1154802-21cron00:15:001
963034994531,8cyclictest0-21swapper/023:29:380
963034994521,14cyclictest12450irq/32-eth023:04:380
963034994510,26cyclictest1162418-21ssh00:24:340
96303499443,31cyclictest1149918-21ssh00:09:360
963034994432,8cyclictest0-21swapper/021:54:360
963034994425,16cyclictest0-21swapper/021:29:360
96303699433,31cyclictest1133081-21ssh23:49:382
963036994329,10cyclictest1142234-21systemd00:00:012
963036994329,10cyclictest1142234-21systemd00:00:012
96303599434,28cyclictest1099671-21ssh23:09:401
963035994338,2cyclictest0-21swapper/123:34:391
963035994334,5cyclictest1035244-21unixbench-2d21:54:451
963035994333,7cyclictest1069894-21ssh22:35:011
963034994335,5cyclictest1-21systemd22:25:010
963034994328,8cyclictest12550irq/33-eth022:34:350
96303699424,34cyclictest1175278-21ssh00:39:402
963036994234,5cyclictest973268-21systemd-run19:45:012
963036994234,5cyclictest973268-21systemd-run19:45:012
963036994216,5cyclictest0-21swapper/219:39:362
963035994234,5cyclictest992240-21systemd-run20:50:091
963035994234,5cyclictest967453-21latency_hist19:25:021
963035994234,5cyclictest1031224-21cron21:50:001
963036994133,5cyclictest1159009-21latency_hist00:20:012
963036994132,6cyclictest369-21systemd-journal22:05:002
963036994132,5cyclictest564-21dbus-daemon22:10:012
96303699411,32cyclictest1103978-21ssh23:14:362
963035994133,4cyclictest0-21swapper/123:20:001
96303599412,34cyclictest1014987-21ssh21:29:371
963034994135,3cyclictest0-21swapper/020:15:010
963034994122,14cyclictest812-21cron19:55:010
963036994032,5cyclictest1100613-21kworker/u8:0-xprtiod23:20:002
963036994030,6cyclictest1166-21mta-sts-daemon19:14:402
96303699402,5cyclictest171rcu_preempt00:14:412
96303699401,35cyclictest1077728-21ssh22:44:332
96303699401,33cyclictest1095332-21ssh23:04:382
963035994031,6cyclictest1166090-21grep00:29:291
96303599402,33cyclictest674-21gdbus22:49:381
963034994033,3cyclictest0-21swapper/000:00:020
963034994033,3cyclictest0-21swapper/000:00:020
963034994032,5cyclictest756-21cups-browsed23:49:390
96303699393,29cyclictest1086462-21ssh22:54:362
96303699393,29cyclictest1086462-21ssh22:54:362
963036993930,5cyclictest974855-21latency_hist19:50:022
963036993927,4cyclictest0-21swapper/200:29:422
963035993931,4cyclictest0-21swapper/100:09:301
963035993925,8cyclictest998069-21diskmemload21:24:381
963034993931,3cyclictest0-21swapper/023:14:390
96303699384,27cyclictest1099648-21ssh23:09:392
963036993829,6cyclictest998069-21diskmemload21:49:362
963036993828,6cyclictest1167-21mta-sts-daemon19:34:382
963036993827,8cyclictest1024552-21sendmail21:40:012
963036993826,9cyclictest1167-21mta-sts-daemon23:44:352
963036993825,11cyclictest351ktimers/221:29:352
963035993833,2cyclictest0-21swapper/120:00:011
963034993825,11cyclictest983503-21systemd-run20:20:010
963034993819,11cyclictest12450irq/32-eth021:39:320
963036993729,5cyclictest1150683-21basename00:10:002
96303699372,31cyclictest1051765-21sh22:14:402
963036993717,14cyclictest351ktimers/221:19:402
963035993730,3cyclictest0-21swapper/121:15:011
963035993730,3cyclictest0-21swapper/121:15:011
96303499374,28cyclictest1064772-21ssh22:29:400
963034993728,7cyclictest1011097-21unixbench_multi21:24:470
963034993728,6cyclictest151ktimers/019:49:410
963036993627,5cyclictest993678-21cron20:55:002
963036993627,5cyclictest993678-21cron20:55:002
963036993626,5cyclictest0-21swapper/221:15:012
963036993626,5cyclictest0-21swapper/221:15:012
96303699361,29cyclictest1137284-21ssh23:54:362
96303699361,28cyclictest1060454-21ssh22:24:392
96303699361,25cyclictest1145647-21ssh00:04:362
96303699361,25cyclictest1145647-21ssh00:04:362
963035993628,5cyclictest998069-21diskmemload22:39:441
963035993628,4cyclictest0-21swapper/123:25:001
963035993626,7cyclictest1157542-21aten_r2power_po00:19:261
963034993629,5cyclictest1158624-21sh00:19:440
963034993629,3cyclictest0-21swapper/000:05:020
963034993629,3cyclictest0-21swapper/000:05:020
963034993628,5cyclictest563-21avahi-daemon23:40:010
963034993617,16cyclictest151ktimers/020:34:390
963034993617,16cyclictest151ktimers/020:34:390
96303499361,27cyclictest1154037-21ssh00:14:390
963036993525,7cyclictest1120950-21sh23:35:012
96303699351,26cyclictest1039138-21ssh21:59:392
96303699351,25cyclictest1124469-21sh23:39:372
963035993529,3cyclictest0-21swapper/123:14:341
963035993527,5cyclictest1024556-21run-parts21:40:011
963035993527,5cyclictest1006633-21unixbench-2d21:19:461
963035993525,7cyclictest1052036-21cat22:14:461
963035993523,9cyclictest968243-21needreboot19:29:361
963034993529,3cyclictest0-21swapper/023:00:000
963034993529,3cyclictest0-21swapper/023:00:000
96303699342,24cyclictest1162428-21ssh00:24:352
963035993429,2cyclictest0-21swapper/100:00:011
963035993429,2cyclictest0-21swapper/100:00:011
963035993426,5cyclictest369-21systemd-journal23:30:001
963035993426,3cyclictest0-21swapper/120:39:381
963035993424,8cyclictest1056267-21mailstats22:19:411
963034993427,5cyclictest995177-21systemd-run21:00:010
963034993425,7cyclictest968669-21timerwakeupswit19:29:470
963034993424,5cyclictest151ktimers/022:39:340
963034993413,15cyclictest1099678-21ssh23:09:400
96303699334,22cyclictest1069062-21ssh22:34:352
963036993324,5cyclictest1171808-21latency_hist00:35:022
963036993323,7cyclictest977610-21sh20:00:012
963036993323,7cyclictest1082660-21unixbench_multi22:49:442
963036993323,6cyclictest990794-21systemd-run20:45:012
963036993323,4cyclictest0-21swapper/222:59:352
963036993323,4cyclictest0-21swapper/222:59:352
96303699332,24cyclictest1064833-21ssh22:29:422
96303599335,18cyclictest577-21mta-sts-daemon20:14:411
963035993327,3cyclictest0-21swapper/122:24:391
963035993327,3cyclictest0-21swapper/121:10:021
963035993320,9cyclictest974077-21needreboot19:49:361
963035993317,12cyclictest756-21cups-browsed23:49:391
963034993327,4cyclictest966511-21fschecks_time19:24:310
963034993326,5cyclictest674-21gdbus20:40:000
96303499332,26cyclictest1047329-21ssh22:09:380
963034993313,11cyclictest998069-21diskmemload23:44:360
96303699329,17cyclictest351ktimers/220:34:402
96303699329,17cyclictest351ktimers/220:34:402
96303699324,21cyclictest563-21avahi-daemon21:04:362
96303699323,25cyclictest1010633-21ssh21:24:412
963036993228,2cyclictest0-21swapper/220:19:402
963036993226,3cyclictest0-21swapper/222:20:012
963035993224,5cyclictest1125070-21unixbench_singl23:39:471
963035993224,4cyclictest0-21swapper/122:44:341
963035993221,8cyclictest1028329-21timerandwakeup21:44:421
96303499328,14cyclictest151ktimers/022:44:330
963034993224,6cyclictest1138282-21latency_hist23:55:020
963034993224,5cyclictest756-21cups-browsed21:30:150
96303499322,26cyclictest1175227-21ssh00:39:390
96303699316,20cyclictest577-21mta-sts-daemon20:09:392
963036993123,5cyclictest1115240-21aten_r2power_vo23:29:282
963036993123,3cyclictest0-21swapper/221:42:532
963035993124,4cyclictest964515-21latency_hist19:15:021
963035993123,5cyclictest1129376-21unixbench_singl23:44:441
963035993123,5cyclictest1047341-21ntp_kernel_pll_22:09:381
963035993122,5cyclictest1065558-21systemd-run22:30:011
963035993116,12cyclictest1175115-21sh00:39:351
963034993123,6cyclictest977616-21munin-plugin-st20:00:010
96303499312,23cyclictest1166686-21ssh00:29:400
96303699303,6cyclictest171rcu_preempt20:24:382
963036993023,4cyclictest975238-21sort19:54:322
963036993023,4cyclictest1019154-21/usr/sbin/munin21:34:312
963036993022,5cyclictest968887-21systemd-run19:30:012
96303699302,15cyclictest1166-21mta-sts-daemon21:54:382
963036993019,8cyclictest994565-21ntp_kernel_pll_20:59:352
96303599305,20cyclictest1038984-21ssh21:59:341
963035993023,4cyclictest1168-21mta-sts-daemon20:24:281
963035993023,4cyclictest0-21swapper/100:25:021
963035993023,3cyclictest0-21swapper/100:34:381
963034993022,3cyclictest0-21swapper/022:14:380
963036992924,2cyclictest0-21swapper/220:40:002
963036992917,5cyclictest0-21swapper/220:14:392
963035992923,3cyclictest0-21swapper/120:04:401
963035992923,3cyclictest0-21swapper/100:04:301
963035992923,3cyclictest0-21swapper/100:04:301
963035992920,6cyclictest1136763-21ssh23:54:291
963035992919,7cyclictest1095534-21switchtime23:04:421
963034992923,4cyclictest970316-21cron19:35:000
963034992923,3cyclictest0-21swapper/000:35:010
963034992922,3cyclictest0-21swapper/021:19:340
963034992921,6cyclictest1-21systemd19:20:010
963034992919,7cyclictest1167-21mta-sts-daemon23:20:160
963034992916,10cyclictest0-21swapper/020:54:480
963034992916,10cyclictest0-21swapper/020:54:480
963034992914,11cyclictest12450irq/32-eth022:04:390
96303599282,23cyclictest1043086-21ssh22:04:351
963035992822,3cyclictest0-21swapper/119:20:011
963035992818,7cyclictest995158-21tr21:00:001
963035992818,7cyclictest975475-21missed_timers19:54:351
96303499283,20cyclictest1030553-21ssh21:49:410
963036992723,2cyclictest0-21swapper/220:04:402
963036992720,4cyclictest966505-21fschecks_time19:24:312
963036992719,5cyclictest997992-21unixbench_multi21:09:462
96303599272,6cyclictest171rcu_preempt20:44:381
963035992719,5cyclictest985479-21fschecks_time20:29:311
963034992722,3cyclictest1107621-21aten_r2power_fr23:19:250
963036992618,5cyclictest963039-21systemd-run19:10:012
963035992618,5cyclictest973253-21munin-plugin-st19:45:001
963035992618,5cyclictest973253-21munin-plugin-st19:45:001
963035992618,5cyclictest1168-21mta-sts-daemon20:34:371
963035992618,5cyclictest1168-21mta-sts-daemon20:34:371
96303499264,9cyclictest1167-21mta-sts-daemon20:49:360
963034992620,4cyclictest972345-21fschecks_time19:44:320
963034992620,4cyclictest972345-21fschecks_time19:44:320
963036992519,3cyclictest1168-21mta-sts-daemon23:20:042
963036992519,3cyclictest0-21swapper/220:29:342
963035992518,4cyclictest1167-21mta-sts-daemon21:02:221
963035992517,5cyclictest970325-21/usr/sbin/munin19:35:011
96303499251,18cyclictest1056046-21ssh22:19:360
963036992412,9cyclictest965346-21ntp_kernel_err19:19:362
963034992418,4cyclictest996632-21systemd-run21:05:010
963034992418,4cyclictest990762-21cron20:45:000
963034992418,4cyclictest963550-21fschecks_count19:14:310
963034992417,4cyclictest0-21swapper/020:24:380
96303499241,17cyclictest756-21cups-browsed20:29:370
963034992317,4cyclictest998063-21cron21:10:000
963034992317,3cyclictest0-21swapper/020:04:400
963034992315,4cyclictest964499-21kworker/u8:12-xprtiod19:39:580
96303599222,15cyclictest979996-21ntpq20:09:371
963035992217,2cyclictest0-21swapper/120:55:001
963035992217,2cyclictest0-21swapper/120:55:001
963035992216,3cyclictest0-21swapper/120:20:011
96303499218,4cyclictest979631-21fschecks_time20:09:300
96303799202,8cyclictest0-21swapper/319:34:373
96303799192,9cyclictest0-21swapper/300:14:413
96303799192,8cyclictest0-21swapper/323:14:353
96303799192,7cyclictest0-21swapper/323:09:373
96303499192,15cyclictest962989-21munin-run19:10:010
96303799184,9cyclictest0-21swapper/323:34:353
96303799184,7cyclictest0-21swapper/300:29:403
96303799184,5cyclictest0-21swapper/321:39:343
96303799184,5cyclictest0-21swapper/319:44:403
96303799184,5cyclictest0-21swapper/319:44:403
96303799182,9cyclictest0-21swapper/300:24:363
96303799181,8cyclictest0-21swapper/323:29:353
96303799181,8cyclictest0-21swapper/321:49:413
96303799181,7cyclictest0-21swapper/319:49:403
96303799173,7cyclictest0-21swapper/321:59:353
96303799172,9cyclictest0-21swapper/323:19:363
96303799172,6cyclictest0-21swapper/321:09:373
96303799172,6cyclictest0-21swapper/320:14:383
96303799171,8cyclictest0-21swapper/323:59:383
96303799171,8cyclictest0-21swapper/323:59:383
96303799171,8cyclictest0-21swapper/320:44:373
96303799171,7cyclictest0-21swapper/323:39:363
96303599171,12cyclictest962989-21/usr/sbin/munin19:10:021
96303799163,6cyclictest0-21swapper/322:09:413
96303799163,6cyclictest0-21swapper/321:19:413
96303799162,8cyclictest0-21swapper/321:24:393
96303799162,7cyclictest0-21swapper/322:34:343
96303799161,7cyclictest0-21swapper/320:39:403
96303799161,6cyclictest0-21swapper/320:54:363
96303799161,6cyclictest0-21swapper/320:54:363
96303799161,6cyclictest0-21swapper/319:39:383
96303799154,6cyclictest0-21swapper/323:49:393
96303799154,5cyclictest0-21swapper/321:54:363
96303799153,6cyclictest0-21swapper/319:29:403
96303799152,8cyclictest0-21swapper/322:14:403
96303799152,7cyclictest0-21swapper/321:29:343
96303799152,7cyclictest0-21swapper/300:04:363
96303799152,7cyclictest0-21swapper/300:04:363
96303799151,8cyclictest0-21swapper/322:54:383
96303799151,8cyclictest0-21swapper/322:54:383
96303799151,8cyclictest0-21swapper/300:39:373
96303799151,8cyclictest0-21swapper/300:19:343
96303799151,6cyclictest0-21swapper/320:19:363
96303799151,6cyclictest0-21swapper/319:14:373
96303799144,5cyclictest0-21swapper/322:24:323
96303799143,6cyclictest0-21swapper/319:25:013
96303799143,5cyclictest0-21swapper/323:21:143
96303799143,5cyclictest0-21swapper/322:04:243
96303799142,8cyclictest0-21swapper/323:04:243
96303799142,7cyclictest0-21swapper/323:44:343
96303799142,7cyclictest0-21swapper/319:19:463
96303799142,6cyclictest0-21swapper/320:30:003
96303799141,9cyclictest0-21swapper/300:09:333
96303799141,8cyclictest0-21swapper/322:49:353
96303799141,7cyclictest0-21swapper/321:34:353
96303799141,7cyclictest0-21swapper/321:04:363
96303799133,6cyclictest0-21swapper/321:14:343
96303799133,6cyclictest0-21swapper/321:14:343
96303799132,7cyclictest0-21swapper/322:39:353
96303799132,7cyclictest0-21swapper/322:19:303
96303799132,6cyclictest0-21swapper/322:41:113
96303799132,5cyclictest0-21swapper/320:24:313
96303799131,8cyclictest0-21swapper/323:54:383
96303799131,8cyclictest0-21swapper/323:00:023
96303799131,8cyclictest0-21swapper/323:00:023
96303799131,7cyclictest0-21swapper/300:34:383
96303799131,5cyclictest0-21swapper/319:54:323
96303799124,5cyclictest0-21swapper/320:34:413
96303799124,5cyclictest0-21swapper/320:34:413
96303799124,4cyclictest0-21swapper/320:50:093
96303799122,6cyclictest0-21swapper/322:29:413
96303799122,6cyclictest0-21swapper/320:04:463
96303799121,7cyclictest0-21swapper/320:59:353
96303799121,6cyclictest0-21swapper/320:09:363
96303799111,6cyclictest0-21swapper/321:44:303
96303799111,6cyclictest0-21swapper/319:59:393
96303799102,6cyclictest0-21swapper/319:10:013
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional