You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-01 - 23:04

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #2, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack2slot7s.osadl.org (updated Sat Aug 01, 2026 12:43:07)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
64421199534,35cyclictest772863-21ssh11:40:532
644211995242,5cyclictest0-21swapper/209:50:522
644211995039,7cyclictest1-21systemd10:40:012
644211994931,9cyclictest727376-21sh10:26:022
644211994837,7cyclictest0-21swapper/211:45:512
64421199462,23cyclictest709007-21ntpq09:55:562
644211994537,4cyclictest0-21swapper/210:35:012
64421199441,37cyclictest678105-21ntpq09:00:522
64421199441,26cyclictest668199-21munin-run08:30:002
644210994436,5cyclictest808272-21systemd-run12:40:021
644210994434,4cyclictest0-21swapper/112:05:501
644209994435,3cyclictest0-21swapper/012:05:520
644209994414,16cyclictest12650irq/32-eth012:10:590
644211994334,5cyclictest1003-21mta-sts-daemon12:00:012
64421199431,36cyclictest763689-21ntpq11:25:492
64421199431,36cyclictest763689-21ntpq11:25:492
644210994334,5cyclictest439-21systemd-logind08:15:021
644209994328,8cyclictest12650irq/32-eth010:35:550
644211994233,6cyclictest793867-21if_wlan012:15:452
644211994226,12cyclictest0-21swapper/209:40:012
64421199422,35cyclictest684349-21ntpq09:15:522
64421199422,34cyclictest679578-21ntpq09:05:492
64421199421,37cyclictest658579-21ntpq07:55:492
64421199421,35cyclictest754205-21diskstats11:10:452
64421199421,35cyclictest648131-21ntpq07:20:512
64421199421,34cyclictest673613-21ntpq08:45:512
64421199421,26cyclictest680193-21diskmemload11:32:582
64421199421,26cyclictest680193-21diskmemload11:32:582
64421199420,37cyclictest676608-21ntpq08:55:532
644211994133,5cyclictest671237-21latency_hist08:40:012
644211994133,5cyclictest0-21swapper/212:40:012
644211994132,5cyclictest719992-21systemd10:15:022
64421199412,22cyclictest745033-21df10:55:432
64421199411,37cyclictest669067-21ntpq08:30:502
64421199411,37cyclictest669067-21ntpq08:30:502
64421199411,37cyclictest652568-21ntpq07:35:502
64421199411,35cyclictest672175-21ntpq08:41:032
64421199411,34cyclictest649634-21ntpq07:25:522
644210994131,6cyclictest717822-21latency10:10:471
644210994131,4cyclictest0-21swapper/109:20:541
644210994131,4cyclictest0-21swapper/109:20:541
64420999415,27cyclictest665-21snmpd08:25:510
644209994135,4cyclictest723015-21munin-run10:20:010
644209994135,4cyclictest723015-21munin-run10:20:010
64420999413,28cyclictest754644-21ssh11:10:530
644211994032,5cyclictest741359-21latency_hist10:50:022
644211994027,8cyclictest420-21avahi-daemon09:40:242
644211994022,14cyclictest0-21swapper/209:46:012
64421199401,35cyclictest742461-21ntpq10:50:542
64421199401,35cyclictest661672-21ntpq08:06:002
64421199401,35cyclictest0-21swapper/207:50:562
64421199401,34cyclictest0-21swapper/210:20:512
64421199401,34cyclictest0-21swapper/210:20:512
644210994034,3cyclictest0-21swapper/109:41:011
644210994032,6cyclictest645706-21systemd-run07:15:011
644210994031,6cyclictest420-21avahi-daemon12:04:051
64421199398,28cyclictest737175-21sh10:41:412
64421199392,32cyclictest785026-21ntpq12:00:502
644211993918,17cyclictest660711-21munin-plugin-st08:05:012
64421199391,33cyclictest0-21swapper/208:10:522
64421199391,32cyclictest666098-21ntpq08:20:492
64421199390,24cyclictest781057-21sed11:55:022
644210993932,4cyclictest649223-21fschecks_count07:25:421
644210993931,5cyclictest666721-21systemd-run08:25:011
644210993927,9cyclictest716946-21ssh10:10:021
644211993831,4cyclictest683248-21cut09:15:012
644211993829,6cyclictest771747-21latency_hist11:40:012
644211993826,8cyclictest4072527-21cups-browsed09:21:532
644211993826,8cyclictest4072527-21cups-browsed09:21:532
64421199382,31cyclictest757647-21ssh11:15:502
64421199381,34cyclictest752300-21ssh11:06:182
64421199381,34cyclictest651046-21ntpq07:30:492
64421199381,33cyclictest715086-21ntpq10:05:532
64421199381,33cyclictest712069-21ntpq10:00:552
64421199381,32cyclictest675132-21ntpq08:50:522
64421199381,20cyclictest789009-21ssh12:06:582
64421199380,35cyclictest760773-21ntpq11:20:582
64421199380,35cyclictest760773-21ntpq11:20:582
64421099383,26cyclictest724249-21ssh10:20:551
64421099383,26cyclictest724249-21ssh10:20:551
644210993829,5cyclictest420-21avahi-daemon10:20:011
644210993829,5cyclictest420-21avahi-daemon10:20:011
64421099382,30cyclictest742535-21ssh10:50:571
644209993830,5cyclictest726051-21cron10:25:000
644209993830,5cyclictest726051-21cron10:25:000
644209993830,5cyclictest265-21systemd-journal09:55:010
644209993829,6cyclictest420-21avahi-daemon10:04:150
64420999381,29cyclictest763740-21ssh11:25:510
64420999381,29cyclictest763740-21ssh11:25:510
64421199372,32cyclictest690631-21ntpq09:25:552
64421199372,32cyclictest690631-21ntpq09:25:552
64421199372,29cyclictest693540-21ntpq09:30:482
64421199372,28cyclictest802600-21aten_r2power_cu12:30:392
64421199372,28cyclictest791105-21ssh12:10:522
644211993716,18cyclictest0-21swapper/212:25:582
64421199371,33cyclictest664192-21/usr/sbin/munin08:15:422
64421199371,32cyclictest722708-21ssh10:19:062
64421199371,32cyclictest722708-21ssh10:19:062
64421199371,32cyclictest654091-21ntpq07:40:532
64421199371,31cyclictest797237-21ssh12:20:512
64421199370,33cyclictest654930-21sshd07:45:372
644210993729,5cyclictest726601-21aten2.4-expect10:25:421
644210993727,7cyclictest265-21systemd-journal11:21:261
644210993727,7cyclictest265-21systemd-journal11:21:261
64421199362,27cyclictest748097-21diskstats11:00:422
64421199361,32cyclictest646425-21/usr/sbin/munin07:15:442
64421199361,32cyclictest644961-21/usr/sbin/munin07:10:462
644210993627,6cyclictest754911-21mailstats11:11:021
644210993626,7cyclictest750444-21/usr/sbin/munin11:05:011
644210993626,6cyclictest4072527-21cups-browsed11:47:211
644209993630,3cyclictest0-21swapper/009:25:440
644209993630,3cyclictest0-21swapper/009:25:440
644209993622,11cyclictest0-21swapper/012:05:010
644210993528,4cyclictest774751-21munin-plugin-st11:45:011
644210993526,7cyclictest805213-21sh12:35:011
644210993526,6cyclictest711579-21grep10:00:441
64420999354,25cyclictest778876-21ssh11:50:480
644209993526,7cyclictest701685-21sh09:45:010
64421199341,30cyclictest644221-21munin-run07:10:012
644210993428,4cyclictest644208-21cyclictest09:50:441
644210993426,5cyclictest683236-21sh09:15:011
644210993425,6cyclictest1001-21mta-sts-daemon10:45:561
644210993422,7cyclictest420-21avahi-daemon10:42:141
644209993427,4cyclictest0-21swapper/008:10:550
644209993427,3cyclictest0-21swapper/010:55:570
644209993423,7cyclictest151ktimers/008:55:500
644209993421,10cyclictest709999-21sshd09:57:290
644209993420,12cyclictest766743-21ntp_kernel_pll_11:30:510
644209993420,12cyclictest766743-21ntp_kernel_pll_11:30:510
644210993327,3cyclictest0-21swapper/112:20:011
644210993327,3cyclictest0-21swapper/109:45:551
644210993326,4cyclictest1002-21mta-sts-daemon07:55:011
644210993325,5cyclictest698586-21cron09:40:001
644210993325,5cyclictest648704-21ls07:25:011
644210993325,5cyclictest1-21systemd12:25:021
644210993321,9cyclictest757397-21kernelversion11:15:451
64421099331,28cyclictest1-21systemd08:45:021
64420999333,7cyclictest12750irq/33-eth012:30:570
644209993327,4cyclictest644208-21cyclictest10:50:480
644209993325,5cyclictest702082-21/usr/sbin/munin09:45:520
644209993323,7cyclictest774765-21systemd-run11:45:010
644209993311,17cyclictest718078-21ssh10:10:530
644210993227,2cyclictest0-21swapper/108:20:011
644210993226,3cyclictest0-21swapper/110:40:011
644210993224,5cyclictest680172-21kworker/u8:9+xprtiod10:31:031
644210993224,5cyclictest677564-21aten_r2power_po09:00:411
644210993224,5cyclictest647224-21sendmail-msp07:20:011
644210993224,5cyclictest0-21swapper/111:31:021
644210993224,5cyclictest0-21swapper/111:31:021
644210993223,6cyclictest651711-21true07:35:011
644209993225,4cyclictest776486-21unixbench_singl11:46:030
644209993225,4cyclictest771738-21ssh11:40:010
644209993225,3cyclictest0-21swapper/012:25:410
644209993224,5cyclictest12650irq/32-eth011:20:570
644209993224,5cyclictest12650irq/32-eth011:20:570
644209993223,6cyclictest420-21avahi-daemon12:23:090
644209993223,6cyclictest4072527-21cups-browsed12:18:240
644210993125,3cyclictest0-21swapper/109:00:011
644210993123,5cyclictest799850-21fschecks_count12:25:441
644210993123,5cyclictest783881-21munin-run12:00:011
644210993123,5cyclictest780827-21cron11:55:011
644210993119,9cyclictest644168-21cut07:10:011
644209993125,4cyclictest655167-21cpuspeed07:45:410
644209993124,5cyclictest421-21dbus-daemon08:40:010
644209993123,5cyclictest738433-21latency_hist10:45:020
644209993123,5cyclictest695551-21systemd09:35:010
644209993121,7cyclictest4072524-21cupsd08:05:560
64420999311,25cyclictest739394-21ntpq10:45:510
644210993024,2cyclictest0-21swapper/109:15:511
644210993023,3cyclictest0-21swapper/109:25:491
644210993023,3cyclictest0-21swapper/109:25:491
644210993021,6cyclictest4072527-21cups-browsed09:33:481
644210993020,7cyclictest658990-21timerwakeupswit07:55:591
64420999306,21cyclictest443-21gpm08:15:500
644209993024,4cyclictest726648-21aten_r2power_vo10:25:420
644209993023,4cyclictest687964-21unixbench-2d09:21:010
644209993023,4cyclictest687964-21unixbench-2d09:21:010
644209993023,3cyclictest0-21swapper/009:35:570
644209993022,5cyclictest4072527-21cups-browsed11:57:490
644209993019,8cyclictest0-21swapper/009:10:460
644210992924,2cyclictest0-21swapper/109:10:011
644210992923,3cyclictest0-21swapper/109:55:451
644210992921,5cyclictest1-21systemd08:55:021
644210992921,5cyclictest0-21swapper/112:15:021
644209992923,4cyclictest659503-21aten_r2power_en08:00:410
644209992923,3cyclictest0-21swapper/011:05:010
644210992822,3cyclictest0-21swapper/111:26:021
644210992822,3cyclictest0-21swapper/111:26:021
644210992821,4cyclictest694-21cron08:35:001
644210992821,4cyclictest694-21cron08:35:001
644210992819,6cyclictest670024-21aten_r2power_fr08:35:391
64421099281,22cyclictest745514-21sh10:55:541
64421099281,10cyclictest751306-21/usr/sbin/munin11:05:461
644209992822,4cyclictest744337-21kworker/u8:1-rpciod11:05:420
644209992822,4cyclictest4170366-21munin-node08:46:030
64420999282,19cyclictest684395-21ntpq09:15:550
644209992821,4cyclictest1002-21mta-sts-daemon07:10:010
644209992819,2cyclictest0-21swapper/012:35:430
644210992720,4cyclictest1003-21mta-sts-daemon08:27:231
644209992722,3cyclictest659100-21unixbench_singl07:56:000
64420999272,18cyclictest730265-21ssh10:30:530
644209992721,4cyclictest651688-21cron07:35:010
644209992719,6cyclictest647913-21latency07:20:440
644209992719,5cyclictest669615-21unixbench_singl08:31:020
644209992719,5cyclictest669615-21unixbench_singl08:31:020
64421099266,13cyclictest1002-21mta-sts-daemon07:35:501
644210992620,3cyclictest0-21swapper/108:05:011
644210992619,4cyclictest1002-21mta-sts-daemon11:35:241
644209992621,2cyclictest0-21swapper/008:45:010
644209992620,4cyclictest657568-21tail07:51:020
644209992620,3cyclictest632585-21kworker/u8:1-xprtiod07:26:000
644209992620,3cyclictest0-21swapper/010:05:530
644209992617,7cyclictest0-21swapper/007:45:010
644209992615,4cyclictest653069-21sed07:36:020
644210992515,8cyclictest673594-21ntp_kernel_pll_08:45:511
64420999256,10cyclictest757709-21ssh11:15:530
644210992414,7cyclictest661103-21aten_r2power_vo08:05:431
644209992418,4cyclictest1001-21mta-sts-daemon09:00:420
644209992417,4cyclictest0-21swapper/007:15:590
64421099232,16cyclictest655660-21ntpq07:45:541
644209992316,5cyclictest0-21swapper/007:11:010
64420999231,18cyclictest666581-21awk08:21:010
64421299223,8cyclictest0-21swapper/309:40:503
64421099222,15cyclictest654063-21ntpq07:40:521
64420999213,11cyclictest428-21mta-sts-daemon08:50:530
644209992112,7cyclictest680207-21ssh09:10:010
64421299192,9cyclictest0-21swapper/311:30:533
64421299192,9cyclictest0-21swapper/311:30:533
64421299192,10cyclictest0-21swapper/312:35:553
64421299192,10cyclictest0-21swapper/312:20:423
64421299184,8cyclictest0-21swapper/311:25:493
64421299184,8cyclictest0-21swapper/311:25:493
64421299183,8cyclictest0-21swapper/311:10:543
64421299182,9cyclictest0-21swapper/312:25:533
64421299182,9cyclictest0-21swapper/311:55:543
64421299182,9cyclictest0-21swapper/311:05:483
64421299182,9cyclictest0-21swapper/310:55:563
64421299182,8cyclictest0-21swapper/309:45:533
64421299182,10cyclictest0-21swapper/310:10:573
64421299182,10cyclictest0-21swapper/309:55:563
64421299181,9cyclictest0-21swapper/310:45:513
64421299172,9cyclictest0-21swapper/309:50:503
64421299172,8cyclictest0-21swapper/309:30:513
64421299172,8cyclictest0-21swapper/309:19:303
64421299172,8cyclictest0-21swapper/309:00:513
64421299172,6cyclictest0-21swapper/307:15:463
64421299172,10cyclictest0-21swapper/310:50:523
64421299171,10cyclictest0-21swapper/311:50:493
64421299171,10cyclictest0-21swapper/310:30:523
64421299164,8cyclictest0-21swapper/311:20:563
64421299164,8cyclictest0-21swapper/311:20:563
64421299164,6cyclictest0-21swapper/309:35:523
64421299162,9cyclictest0-21swapper/310:40:553
64421299162,8cyclictest0-21swapper/311:40:543
64421299161,9cyclictest0-21swapper/311:35:533
64421299161,9cyclictest0-21swapper/309:20:443
64421299161,9cyclictest0-21swapper/309:20:443
64421299161,8cyclictest0-21swapper/309:25:493
64421299161,8cyclictest0-21swapper/309:25:493
64421299161,7cyclictest0-21swapper/308:30:513
64421299161,7cyclictest0-21swapper/308:30:513
64421299153,7cyclictest0-21swapper/310:20:463
64421299153,7cyclictest0-21swapper/310:20:463
64421299152,9cyclictest0-21swapper/311:15:433
64421299152,9cyclictest0-21swapper/310:35:423
64421299152,9cyclictest0-21swapper/307:25:023
64421299152,8cyclictest0-21swapper/310:15:483
64421299152,8cyclictest0-21swapper/310:15:483
64421299152,8cyclictest0-21swapper/309:10:013
64421299152,7cyclictest0-21swapper/310:00:533
64421299151,9cyclictest0-21swapper/312:15:503
64421299151,8cyclictest0-21swapper/312:30:493
64421299151,8cyclictest0-21swapper/312:10:013
64421299151,8cyclictest0-21swapper/310:25:563
64421299151,8cyclictest0-21swapper/309:10:533
64421299151,7cyclictest0-21swapper/308:55:523
64421299151,7cyclictest0-21swapper/308:35:533
64421299151,7cyclictest0-21swapper/308:15:513
64421299151,7cyclictest0-21swapper/307:55:473
64421299151,6cyclictest0-21swapper/308:50:503
64421299151,6cyclictest0-21swapper/308:40:533
64421299143,8cyclictest0-21swapper/311:00:473
64421299143,8cyclictest0-21swapper/310:05:393
64421299141,8cyclictest0-21swapper/312:00:393
64421299141,7cyclictest0-21swapper/308:10:553
64421299141,6cyclictest0-21swapper/308:00:513
64421299141,6cyclictest0-21swapper/307:45:483
64421299133,7cyclictest0-21swapper/311:45:403
64421299133,6cyclictest0-21swapper/307:50:553
64421299133,6cyclictest0-21swapper/307:25:543
64421299132,7cyclictest0-21swapper/312:10:423
64421299132,6cyclictest0-21swapper/307:35:013
64421299132,5cyclictest0-21swapper/308:45:483
64421299122,6cyclictest0-21swapper/308:25:553
64421299121,6cyclictest0-21swapper/308:20:473
64421299121,6cyclictest0-21swapper/308:05:543
64421299121,6cyclictest0-21swapper/307:40:533
64421299121,6cyclictest0-21swapper/307:35:493
64421299121,6cyclictest0-21swapper/307:10:483
6442129981,4cyclictest0-21swapper/307:10:023
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional