You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-14 - 14:52

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #2, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack2slot7s.osadl.org (updated Tue Apr 14, 2026 12:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2421529996661,3cyclictest2469765-21kworker/u8:13-xprtiod09:40:052
2421529996661,3cyclictest2469765-21kworker/u8:13-xprtiod09:40:052
2421527995638,14cyclictest2571666-21df11:30:300
2421527995240,10cyclictest2481963-40mandb09:40:070
2421527995240,10cyclictest2481963-40mandb09:40:070
2421527995134,14cyclictest2481963-40mandb09:40:020
2421529995044,2cyclictest0-21swapper/209:40:042
2421529994739,5cyclictest421-21dbus-daemon08:10:012
2421529994624,16cyclictest421-21dbus-daemon09:55:392
2421529994536,6cyclictest439-21systemd-logind12:00:022
2421528994537,4cyclictest0-21swapper/111:10:021
2421527994537,5cyclictest2542644-21idleruntime-cro10:55:010
2421527994528,14cyclictest2448602-21latency_hist08:40:010
2421527994528,14cyclictest2448602-21latency_hist08:40:010
2421529994436,5cyclictest1054-21mta-sts-daemon07:40:012
2421529994435,6cyclictest1550375-21cups-browsed12:14:372
2421529994433,8cyclictest2475435-21timerandwakeup09:30:462
2421529994433,8cyclictest2475435-21timerandwakeup09:30:462
2421527994436,5cyclictest2491492-21mailstats09:50:450
2421529994333,7cyclictest421-21dbus-daemon12:40:012
2421528994333,7cyclictest1-21systemd10:20:011
2421529994233,6cyclictest420-21avahi-daemon07:25:012
2421528994235,4cyclictest2456089-21systemd-run09:05:021
2421528994234,5cyclictest0-21swapper/112:40:011
2421529994131,7cyclictest2469768-21sh09:25:012
2421529994131,6cyclictest2602270-21sshd12:08:292
2421528994132,4cyclictest0-21swapper/109:35:471
2421529994033,4cyclictest2614958-21cron12:25:012
2421529994033,4cyclictest2546797-21latency_hist11:00:022
2421529994032,5cyclictest1-21systemd10:45:012
2421529994031,4cyclictest0-21swapper/211:02:032
2421528994031,6cyclictest421-21dbus-daemon10:15:011
2421528994028,9cyclictest2482869-21if_wlan009:40:321
2421528994028,9cyclictest2482869-21if_wlan009:40:321
2421528994028,8cyclictest2532120-21switchtime10:40:501
2421527994035,2cyclictest0-21swapper/007:20:010
2421529993933,3cyclictest0-21swapper/209:00:012
242152999393,26cyclictest2608264-21ssh12:15:402
2421529993932,3cyclictest0-21swapper/211:25:502
2421529993931,5cyclictest2526460-21cron10:35:012
2421529993931,5cyclictest2522435-21munin-run10:30:002
2421529993930,6cyclictest420-21avahi-daemon09:45:562
2421529993930,6cyclictest420-21avahi-daemon09:45:562
2421529993929,4cyclictest0-21swapper/210:20:362
2421528993931,5cyclictest421-21dbus-daemon10:05:021
2421528993931,5cyclictest2614976-21munin-plugin-st12:25:011
2421528993931,4cyclictest2481955-21kworker/u8:16-events_unbound10:50:261
2421528993930,5cyclictest421-21dbus-daemon11:17:411
242152899392,32cyclictest2576261-21ssh11:35:441
2421527993932,5cyclictest2436537-21systemd-run08:00:010
2421527993932,5cyclictest1054-21mta-sts-daemon08:25:360
2421527993932,4cyclictest2470615-21if_wlan009:25:310
2421527993932,4cyclictest2470615-21if_wlan009:25:310
2421527993930,6cyclictest2613170-21sshd12:21:290
2421529993831,5cyclictest0-21swapper/209:55:002
242152899383,30cyclictest2503389-21ssh10:05:351
2421528993829,6cyclictest2459324-21unixbench_multi09:10:481
2421528993829,5cyclictest0-21swapper/111:20:441
2421527993831,4cyclictest420-21avahi-daemon09:45:120
2421527993831,4cyclictest420-21avahi-daemon09:45:120
2421527993830,5cyclictest2555815-21missed_timers11:10:330
2421529993731,3cyclictest0-21swapper/209:20:002
2421529993731,3cyclictest0-21swapper/209:20:002
2421529993729,3cyclictest0-21swapper/211:15:412
242152999372,28cyclictest2503420-21ssh10:05:362
2421527993730,5cyclictest2435023-21systemd-run07:55:010
2421527993728,6cyclictest2607019-21/usr/sbin/munin12:15:020
2421529993629,3cyclictest0-21swapper/211:35:302
2421529993628,5cyclictest2456092-21systemd09:05:022
2421528993629,3cyclictest0-21swapper/111:45:411
2421528993629,3cyclictest0-21swapper/111:45:411
2421528993628,5cyclictest2430557-21latency_hist07:40:011
2421528993628,5cyclictest1055-21mta-sts-daemon07:20:381
2421527993628,6cyclictest2506304-21munin-plugin-st10:10:010
2421527993616,13cyclictest151ktimers/008:20:430
2421527993614,12cyclictest151ktimers/009:00:380
242152999353,26cyclictest2620267-21ssh12:30:432
2421529993530,2cyclictest0-21swapper/207:40:392
2421529993527,5cyclictest2616699-21sed12:25:492
2421529993527,4cyclictest0-21swapper/207:15:292
2421529993526,6cyclictest1550375-21cups-browsed10:17:062
2421529993518,12cyclictest753-21ntpd11:50:402
2421529993518,12cyclictest753-21ntpd11:50:402
242152899353,23cyclictest441-21gpm07:10:371
2421528993529,3cyclictest0-21swapper/112:00:011
2421528993527,5cyclictest2536325-21unixbench_multi10:45:491
2421528993527,5cyclictest2498176-21cat10:00:011
2421528993527,4cyclictest1054-21mta-sts-daemon12:16:411
2421528993527,4cyclictest0-21swapper/109:45:391
2421528993527,4cyclictest0-21swapper/109:45:391
2421527993529,4cyclictest2586991-21cron11:50:010
2421527993529,4cyclictest2586991-21cron11:50:010
2421527993528,5cyclictest420-21avahi-daemon10:15:020
2421527993527,5cyclictest2450080-21systemd-run08:45:010
2421529993427,3cyclictest0-21swapper/212:00:412
2421529993426,5cyclictest2435510-21fschecks_count07:55:292
2421529993422,9cyclictest2507322-21missed_timers10:10:332
242152999342,27cyclictest2527835-21ssh10:35:452
2421528993428,3cyclictest0-21swapper/110:40:011
2421528993426,3cyclictest0-21swapper/109:15:401
2421528993426,3cyclictest0-21swapper/109:15:401
2421528993423,7cyclictest420-21avahi-daemon11:10:211
2421527993429,2cyclictest0-21swapper/012:34:140
2421527993427,4cyclictest0-21swapper/011:05:400
2421527993426,6cyclictest1550375-21cups-browsed11:35:520
2421527993425,3cyclictest2535314-21fschecks_count10:45:290
2421527993423,9cyclictest2615642-21sort12:25:280
2421527993423,9cyclictest2544442-21tail10:55:490
2421527993422,9cyclictest2563499-21aten_r2power_po11:20:300
2421529993328,2cyclictest0-21swapper/211:10:012
2421529993327,3cyclictest0-21swapper/208:45:292
2421529993327,2cyclictest0-21swapper/211:50:022
2421529993327,2cyclictest0-21swapper/211:50:022
2421529993325,5cyclictest2458689-21ntp_kernel_err09:10:342
242152999332,25cyclictest2535700-21ssh10:45:352
242152999332,24cyclictest2555990-21ssh11:10:372
2421528993326,4cyclictest2574927-21cron11:35:001
2421528993326,4cyclictest2453066-21systemd-run08:55:011
2421528993325,5cyclictest2619442-21aten_r2power_en12:30:271
2421528993324,6cyclictest2450080-21systemd-run08:45:011
2421528993324,6cyclictest1550375-21cups-browsed07:15:291
2421528993323,7cyclictest2434039-21/usr/sbin/munin07:50:291
2421527993328,2cyclictest0-21swapper/010:20:340
2421527993328,2cyclictest0-21swapper/010:15:300
2421527993327,3cyclictest0-21swapper/009:20:350
2421527993326,5cyclictest0-21swapper/009:15:270
2421527993326,5cyclictest0-21swapper/009:15:270
242152799331,27cyclictest2596299-21sh12:00:400
242152999323,22cyclictest2499326-21ssh10:00:362
2421529993226,3cyclictest0-21swapper/211:30:552
2421529993224,5cyclictest2579575-21aten_r2power_po11:40:322
2421529993224,4cyclictest2566942-21systemd-run11:25:012
2421529993224,3cyclictest0-21swapper/210:55:012
242152899326,18cyclictest428-21mta-sts-daemon10:20:381
2421528993223,6cyclictest2520172-21unixbench-2d10:25:541
2421528993223,5cyclictest0-21swapper/112:00:381
2421527993226,4cyclictest2582978-21idleruntime-cro11:45:010
2421527993226,4cyclictest2474564-21fschecks_count09:30:280
2421527993226,4cyclictest2474564-21fschecks_count09:30:280
2421527993225,5cyclictest420-21avahi-daemon10:25:540
2421527993224,5cyclictest1550375-21cups-browsed07:26:400
2421527993223,6cyclictest2446229-21latency08:30:330
2421527993222,6cyclictest12350irq/32-eth011:15:390
2421529993123,4cyclictest0-21swapper/209:25:432
2421529993123,4cyclictest0-21swapper/209:25:432
2421529993122,6cyclictest1-21systemd08:20:012
2421528993124,4cyclictest2446037-21fschecks_time08:30:311
2421528993123,6cyclictest2441517-21fschecks_count08:15:311
2421528993122,6cyclictest2547472-21fschecks_count11:00:291
2421528993122,6cyclictest1054-21mta-sts-daemon12:29:061
2421528993121,8cyclictest2474432-21cpu09:30:261
2421528993121,8cyclictest2474432-21cpu09:30:261
2421528993119,9cyclictest2543678-21missed_timers10:55:331
242152799317,11cyclictest624-21lldpd11:55:420
2421527993124,3cyclictest0-21swapper/010:30:440
2421527993117,11cyclictest0-21swapper/009:55:270
242152799311,24cyclictest261-21systemd-journal12:06:300
2421529993020,7cyclictest2446408-21ntp_kernel_pll_08:30:382
2421529993019,8cyclictest2440779-21timerwakeupswit08:10:472
2421528993024,3cyclictest0-21swapper/109:25:411
2421528993024,3cyclictest0-21swapper/109:25:411
2421528993022,5cyclictest2599537-21aten_r2power_en12:05:271
2421528993022,5cyclictest2580194-21ntp_kernel_pll_11:40:421
2421528993022,5cyclictest2490944-21awk09:50:311
2421527993024,4cyclictest2450573-21fschecks_count08:45:280
2421527993023,5cyclictest1550375-21cups-browsed11:25:240
2421527993023,4cyclictest1056-21mta-sts-daemon12:15:400
242152799302,22cyclictest2588271-21ssh11:50:390
242152799302,22cyclictest2588271-21ssh11:50:390
2421529992924,2cyclictest0-21swapper/208:05:012
2421529992924,2cyclictest0-21swapper/207:45:472
2421529992921,5cyclictest2453049-21idleruntime-cro08:55:012
2421529992921,5cyclictest2443729-21find08:20:512
2421528992923,3cyclictest0-21swapper/109:20:311
2421528992922,4cyclictest0-21swapper/109:05:381
2421528992922,3cyclictest0-21swapper/110:30:401
242152899292,15cyclictest1056-21mta-sts-daemon08:39:001
242152899292,15cyclictest1056-21mta-sts-daemon08:39:001
2421527992923,3cyclictest0-21swapper/010:40:330
2421527992922,4cyclictest2454426-21tail08:55:490
2421527992922,4cyclictest0-21swapper/010:00:390
2421527992921,6cyclictest1054-21mta-sts-daemon10:37:090
2421527992920,7cyclictest2425337-21needreboot07:20:330
242152999283,18cyclictest421-21dbus-daemon08:25:362
2421529992820,5cyclictest0-21swapper/207:30:022
2421528992821,4cyclictest1051-21mta-sts-daemon11:53:331
2421528992821,4cyclictest1051-21mta-sts-daemon11:53:331
2421528992821,3cyclictest0-21swapper/111:25:431
2421528992819,6cyclictest2432007-21cron07:45:001
2421527992822,4cyclictest2623724-21fschecks_time12:35:320
2421527992819,7cyclictest516-21in:imuxsock09:14:290
2421527992819,6cyclictest2432021-21idleruntime-cro07:45:000
2421529992721,3cyclictest0-21swapper/208:40:292
2421529992721,3cyclictest0-21swapper/208:40:002
2421529992721,3cyclictest0-21swapper/208:40:002
2421528992719,5cyclictest0-21swapper/108:25:021
2421528992715,9cyclictest421-21dbus-daemon12:15:031
242152799273,20cyclictest2547906-21ssh11:00:360
2421527992721,3cyclictest2422912-21unixbench_multi07:10:460
2421529992619,3cyclictest0-21swapper/209:10:012
242152899265,16cyclictest600-21gmain07:55:371
2421528992619,4cyclictest2440524-21proc_pri08:10:431
2421527992621,2cyclictest0-21swapper/007:40:000
2421527992618,6cyclictest2453065-21sh08:55:010
2421527992618,5cyclictest0-21swapper/009:10:030
2421529992517,5cyclictest2428046-21fschecks_time07:30:292
2421529992517,5cyclictest2428046-21fschecks_time07:30:292
242152899253,16cyclictest659-21snmpd08:25:371
2421528992520,2cyclictest0-21swapper/108:50:011
2421528992519,3cyclictest0-21swapper/107:35:001
2421528992519,3cyclictest0-21swapper/107:35:001
2421528992518,3cyclictest0-21swapper/107:45:421
242152799259,12cyclictest421-21dbus-daemon08:05:360
2421527992520,3cyclictest0-21swapper/007:50:010
2421527992519,4cyclictest2441520-21sort08:15:310
242152999245,12cyclictest428-21mta-sts-daemon07:10:362
2421528992417,5cyclictest0-21swapper/108:10:011
2421528992415,6cyclictest1550375-21cups-browsed08:57:421
242152999235,13cyclictest428-21mta-sts-daemon07:50:302
2421528992315,5cyclictest1550375-21cups-browsed08:02:181
2421527992318,3cyclictest0-21swapper/008:00:290
242152799231,11cyclictest2439998-21df_inode08:10:290
242153099222,4cyclictest0-21swapper/309:40:053
2421528992217,2cyclictest0-21swapper/107:10:021
2421528992216,3cyclictest0-21swapper/107:25:381
2421527992210,10cyclictest0-21swapper/007:30:270
2421527992210,10cyclictest0-21swapper/007:30:270
242153099202,8cyclictest0-21swapper/310:15:393
2421527992014,4cyclictest0-21swapper/007:10:010
242153099181,10cyclictest0-21swapper/311:10:363
242153099173,9cyclictest0-21swapper/309:55:393
242153099172,8cyclictest0-21swapper/311:15:363
242153099172,8cyclictest0-21swapper/308:25:363
242153099171,7cyclictest0-21swapper/312:25:383
242153099163,8cyclictest0-21swapper/310:05:343
242153099163,8cyclictest0-21swapper/309:40:053
242153099163,8cyclictest0-21swapper/309:40:053
242153099163,7cyclictest0-21swapper/309:30:343
242153099163,7cyclictest0-21swapper/309:30:343
242153099162,8cyclictest0-21swapper/312:30:423
242153099162,6cyclictest0-21swapper/310:50:343
242153099162,10cyclictest0-21swapper/310:55:413
242153099161,7cyclictest0-21swapper/311:40:443
242152999165,8cyclictest421-21dbus-daemon07:10:012
242153099153,8cyclictest0-21swapper/310:10:423
242153099153,7cyclictest0-21swapper/312:05:443
242153099152,7cyclictest0-21swapper/312:15:403
242153099152,7cyclictest0-21swapper/310:45:423
242153099152,7cyclictest0-21swapper/309:15:363
242153099152,7cyclictest0-21swapper/309:15:363
242153099151,8cyclictest0-21swapper/312:35:423
242153099151,8cyclictest0-21swapper/311:50:353
242153099151,8cyclictest0-21swapper/311:50:353
242153099151,8cyclictest0-21swapper/311:45:363
242153099151,8cyclictest0-21swapper/311:45:363
242153099151,8cyclictest0-21swapper/311:00:353
242153099151,7cyclictest0-21swapper/309:50:353
242153099151,7cyclictest0-21swapper/309:10:353
242153099151,7cyclictest0-21swapper/308:05:343
242153099143,6cyclictest0-21swapper/310:30:293
242153099143,5cyclictest0-21swapper/309:25:393
242153099143,5cyclictest0-21swapper/309:25:393
242153099142,8cyclictest0-21swapper/310:25:463
242153099142,7cyclictest0-21swapper/312:10:423
242153099142,7cyclictest0-21swapper/310:35:433
242153099142,7cyclictest0-21swapper/310:20:343
242153099142,6cyclictest0-21swapper/311:55:373
242153099142,6cyclictest0-21swapper/310:00:363
242153099141,8cyclictest0-21swapper/311:25:403
242153099141,7cyclictest0-21swapper/308:20:413
242153099141,7cyclictest0-21swapper/308:15:373
242153099141,7cyclictest0-21swapper/308:10:383
242153099141,7cyclictest0-21swapper/307:35:463
242153099141,6cyclictest0-21swapper/307:40:343
242153099133,7cyclictest0-21swapper/310:40:463
242153099132,7cyclictest0-21swapper/312:20:423
242153099132,7cyclictest0-21swapper/311:25:003
242153099132,7cyclictest0-21swapper/307:25:013
242153099132,5cyclictest0-21swapper/308:50:373
242153099132,5cyclictest0-21swapper/308:30:413
242153099131,7cyclictest0-21swapper/312:00:363
242153099131,7cyclictest0-21swapper/311:30:333
242153099131,7cyclictest0-21swapper/308:45:423
242153099131,7cyclictest0-21swapper/308:00:383
242153099131,7cyclictest0-21swapper/307:45:343
242153099131,6cyclictest0-21swapper/311:35:283
242153099123,5cyclictest0-21swapper/309:10:013
242153099122,7cyclictest0-21swapper/309:45:323
242153099122,7cyclictest0-21swapper/309:45:323
242153099122,7cyclictest0-21swapper/307:30:013
242153099122,6cyclictest0-21swapper/311:05:373
242153099121,7cyclictest0-21swapper/309:20:423
242153099121,6cyclictest0-21swapper/308:35:433
242153099121,6cyclictest0-21swapper/308:35:433
242153099112,6cyclictest0-21swapper/307:35:013
242153099112,6cyclictest0-21swapper/307:35:013
242153099111,6cyclictest0-21swapper/308:55:413
242153099111,6cyclictest0-21swapper/308:40:493
242153099111,6cyclictest0-21swapper/307:15:343
242153099111,5cyclictest0-21swapper/309:00:343
242153099101,6cyclictest0-21swapper/307:50:293
242153099101,5cyclictest0-21swapper/307:10:263
24215309994,3cyclictest0-21swapper/307:55:373
24215309981,4cyclictest0-21swapper/307:10:023
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional