You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-12 - 16:27

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #2, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack2slot7s.osadl.org (updated Sun Jul 12, 2026 12:43:17)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
886788995947,6cyclictest0-21swapper/109:40:551
886788995646,6cyclictest1-21systemd09:10:011
886788995646,6cyclictest1-21systemd09:10:011
886787995242,6cyclictest1037830-21latency_hist12:20:020
886787995041,6cyclictest12650irq/32-eth009:15:500
886787995039,7cyclictest421-21dbus-daemon12:25:300
886787995024,7cyclictest960908-21unixbench_singl10:10:520
886788994941,5cyclictest910795-21systemd-run08:30:021
886789994840,5cyclictest953180-21systemctl10:00:012
88678799483,27cyclictest443-21gpm09:55:410
886789994739,5cyclictest979097-21unixbench_singl10:40:532
886789994739,5cyclictest979097-21unixbench_singl10:40:532
886788994635,5cyclictest0-21swapper/107:30:401
886789994532,10cyclictest926830-21needreboot09:15:422
886787994527,3cyclictest1026106-21aten_r2power_cu12:00:290
886788994436,4cyclictest921249-21kworker/u8:13-xprtiod09:50:011
886789994338,2cyclictest0-21swapper/209:05:442
886789994338,2cyclictest0-21swapper/209:05:442
886787994320,17cyclictest12650irq/32-eth010:15:400
88678999423,30cyclictest1038866-21ssh12:20:432
886788994234,5cyclictest1040691-21ssh12:25:011
886789994133,5cyclictest950145-21ssh09:55:012
886788994135,3cyclictest0-21swapper/109:55:011
886788994133,5cyclictest956239-21systemd-run10:05:011
886788994133,5cyclictest1003293-21unixbench_multi11:20:521
886789994031,6cyclictest1028726-21systemd-run12:05:012
886789994031,5cyclictest1002961-21sendmail_mailst11:20:482
886789994030,6cyclictest89824-21cups-browsed11:28:152
886789994030,5cyclictest0-21swapper/210:15:422
886788994032,5cyclictest897305-21systemd-run07:45:011
886788994028,9cyclictest1020658-21missed_timers11:50:371
88678899402,31cyclictest927016-21ssh09:15:491
886789993930,6cyclictest1-21systemd10:35:022
886789993928,4cyclictest1002-21mta-sts-daemon11:15:582
886788993931,5cyclictest983470-21systemd-run10:50:011
886788993930,6cyclictest941045-21sendmail09:40:011
886787993932,4cyclictest941045-21sendmail09:40:010
886789993830,5cyclictest888293-21systemd-run07:15:012
886789993827,7cyclictest420-21avahi-daemon11:48:252
886788993829,6cyclictest980424-21cron10:45:001
886788993829,6cyclictest980424-21cron10:45:001
886788993828,7cyclictest0-21swapper/111:35:461
886787993831,4cyclictest1044757-21ntp_kernel_pll_12:30:410
886787993826,4cyclictest972999-21tail10:30:540
886789993728,6cyclictest420-21avahi-daemon09:41:582
886789993727,6cyclictest1010799-21latency_hist11:35:022
886789993717,16cyclictest351ktimers/207:15:432
88678999371,28cyclictest1035844-21sh12:15:422
886788993729,5cyclictest892802-21systemd-run07:30:021
886788993727,4cyclictest0-21swapper/109:20:451
886788993725,8cyclictest968327-21cron10:25:011
886787993724,9cyclictest1-21systemd11:40:300
886789993630,3cyclictest0-21swapper/212:25:422
886789993629,3cyclictest0-21swapper/209:20:452
886789993629,3cyclictest0-21swapper/208:50:462
886789993629,3cyclictest0-21swapper/208:40:012
886789993627,6cyclictest89824-21cups-browsed12:14:412
886789993623,9cyclictest938983-21missed_timers09:35:402
886787993629,4cyclictest987182-21fschecks_time10:55:330
886787993629,4cyclictest1000-21mta-sts-daemon10:52:070
886787993629,4cyclictest1000-21mta-sts-daemon10:52:070
886787993628,6cyclictest924107-21mailstats09:10:470
886787993627,6cyclictest420-21avahi-daemon10:49:420
886787993621,12cyclictest1018334-21unixbench_multi11:45:540
886787993620,10cyclictest12750irq/33-eth012:20:440
886789993529,3cyclictest0-21swapper/211:40:012
886789993526,6cyclictest439-21systemd-logind10:30:022
886789993526,5cyclictest1022689-21cron11:55:012
88678899357,7cyclictest28-21ksoftirqd/111:25:411
886788993529,3cyclictest1003-21mta-sts-daemon10:50:461
886788993529,3cyclictest1003-21mta-sts-daemon10:50:461
886788993528,4cyclictest911283-21fschecks_count08:30:331
886788993525,6cyclictest89824-21cups-browsed11:55:231
886788993519,9cyclictest171rcu_preempt08:50:431
886787993527,5cyclictest938036-21systemd-run09:35:010
886787993527,5cyclictest89824-21cups-browsed11:28:260
886787993526,6cyclictest420-21avahi-daemon11:31:110
886787993521,10cyclictest151ktimers/009:00:490
886787993521,10cyclictest151ktimers/009:00:490
886789993428,4cyclictest886786-21cyclictest08:25:012
886789993428,3cyclictest0-21swapper/212:40:012
886789993426,5cyclictest905798-21processes08:10:472
886789993426,5cyclictest897921-21kernelversion07:45:342
886789993426,5cyclictest439-21systemd-logind10:05:022
886789993425,6cyclictest1000-21mta-sts-daemon12:09:172
886789993425,6cyclictest1000-21mta-sts-daemon12:09:172
886789993414,3cyclictest0-21swapper/209:10:452
88678999341,26cyclictest89824-21cups-browsed09:00:492
88678999341,26cyclictest89824-21cups-browsed09:00:492
886788993427,4cyclictest931895-21kworker/u8:0-rpciod09:30:521
886788993425,4cyclictest0-21swapper/110:05:451
886788993422,3cyclictest171rcu_preempt12:15:021
886787993428,4cyclictest993249-21fschecks_time11:05:330
886787993428,3cyclictest0-21swapper/010:00:450
886787993427,4cyclictest944102-21idleruntime-cro09:45:010
886789993326,4cyclictest1001-21mta-sts-daemon07:40:452
886789993326,4cyclictest1000-21mta-sts-daemon09:30:432
886789993325,5cyclictest904795-21systemd-run08:10:012
886789993325,5cyclictest893307-21fschecks_time07:30:332
886789993324,6cyclictest1046711-21latency_hist12:35:022
886789993324,5cyclictest993602-21ntpq11:05:392
886789993322,8cyclictest919786-21idleruntime-cro09:00:012
886788993326,4cyclictest976048-21unixbench_singl10:35:521
886788993326,3cyclictest0-21swapper/110:30:021
886788993311,8cyclictest895241-21ntp_states07:35:431
886787993327,4cyclictest977409-21munin-run10:40:010
886787993327,4cyclictest947782-21fschecks_count09:50:320
886787993327,4cyclictest1001776-21latency_hist11:20:020
886787993326,5cyclictest89824-21cups-browsed07:55:360
886787993325,5cyclictest1002357-21fschecks_time11:20:340
886787993324,7cyclictest997266-21unixbench_singl11:10:530
886789993226,3cyclictest0-21swapper/208:00:012
886789993224,5cyclictest984954-21timerandwakeup10:50:522
886789993224,5cyclictest984954-21timerandwakeup10:50:522
886789993224,5cyclictest892773-21cron07:30:012
88678899327,6cyclictest28-21ksoftirqd/109:00:421
88678899327,6cyclictest28-21ksoftirqd/109:00:421
88678899322,8cyclictest28-21ksoftirqd/112:00:391
886788993225,4cyclictest974372-21cron10:35:011
886788993223,6cyclictest924409-21unixbench_multi09:10:501
886788993214,3cyclictest171rcu_preempt10:55:441
886788993210,5cyclictest28-21ksoftirqd/108:55:401
886787993225,5cyclictest1013752-21munin-plugin-st11:40:010
886787993225,4cyclictest1034813-21sh12:15:020
886787993224,4cyclictest0-21swapper/010:20:480
886787993223,6cyclictest1029750-21ssh12:05:390
886787993223,6cyclictest1029750-21ssh12:05:390
886787993222,7cyclictest933566-21unixbench_multi09:25:510
886789993123,5cyclictest909798-21fschecks_count08:25:342
886789993123,5cyclictest439-21systemd-logind08:45:012
88678899319,5cyclictest28-21ksoftirqd/111:10:331
88678899319,5cyclictest28-21ksoftirqd/107:45:381
88678899319,5cyclictest271ktimers/111:45:431
88678899317,14cyclictest28-21ksoftirqd/110:13:111
88678899313,22cyclictest990567-21ssh11:00:391
886788993126,3cyclictest886786-21cyclictest11:40:051
886788993123,5cyclictest1001-21mta-sts-daemon09:25:571
886788993121,8cyclictest886797-21sh07:10:011
886788993121,8cyclictest886797-21sh07:10:011
886788993119,2cyclictest171rcu_preempt09:55:391
886788993116,10cyclictest964649-21sshd10:17:581
886788993111,5cyclictest28-21ksoftirqd/107:20:421
886788993110,5cyclictest28-21ksoftirqd/112:35:411
886788993110,5cyclictest28-21ksoftirqd/108:00:401
886788993110,5cyclictest28-21ksoftirqd/108:00:401
886787993124,4cyclictest1003-21mta-sts-daemon12:39:100
886787993123,6cyclictest902676-21ntp_kernel_pll_08:00:420
886787993123,6cyclictest902676-21ntp_kernel_pll_08:00:420
886787993123,5cyclictest957106-21latency10:05:360
886787993123,5cyclictest944450-21/usr/sbin/munin09:45:290
88678799311,26cyclictest1020868-21rm11:50:440
88678999304,12cyclictest922771-21diskmemload11:03:182
886789993023,3cyclictest0-21swapper/210:40:032
886789993022,5cyclictest0-21swapper/212:00:012
886789993022,3cyclictest0-21swapper/210:20:462
88678999302,20cyclictest996699-21ssh11:10:412
886789993021,3cyclictest0-21swapper/210:55:392
88678899306,4cyclictest28-21ksoftirqd/112:30:451
886788993024,3cyclictest0-21swapper/111:15:341
886788993017,9cyclictest993390-21kernelversion11:05:351
886788993016,7cyclictest28-21ksoftirqd/107:55:411
886787993025,3cyclictest1002-21mta-sts-daemon08:10:400
886787993024,3cyclictest0-21swapper/009:00:010
886787993023,4cyclictest887303-21fschecks_time07:10:340
886787993023,3cyclictest0-21swapper/010:40:290
886787993023,3cyclictest0-21swapper/010:40:290
886787993022,5cyclictest421-21dbus-daemon08:50:010
886787993021,6cyclictest421-21dbus-daemon09:20:490
886787993019,8cyclictest894290-21systemd-run07:35:010
88678799301,24cyclictest969495-21rm10:25:420
886789992922,4cyclictest1003-21mta-sts-daemon10:13:542
886789992921,5cyclictest1000-21mta-sts-daemon07:25:012
88678899298,4cyclictest28-21ksoftirqd/107:50:401
88678899297,5cyclictest28-21ksoftirqd/112:15:401
886788992923,3cyclictest0-21swapper/108:40:011
886788992922,4cyclictest904708-21unixbench_singl08:05:511
886787992922,4cyclictest0-21swapper/011:00:480
886787992921,5cyclictest420-21avahi-daemon11:55:200
886787992920,6cyclictest895759-21cron07:40:010
886789992822,3cyclictest0-21swapper/208:05:002
886789992822,3cyclictest0-21swapper/208:05:002
886789992821,4cyclictest945065-21needreboot09:45:362
886789992821,3cyclictest0-21swapper/211:40:382
886789992821,3cyclictest0-21swapper/210:05:512
886789992819,4cyclictest351ktimers/207:50:412
886789992817,8cyclictest933378-21timerandwakeup09:25:502
88678899288,5cyclictest28-21ksoftirqd/112:25:431
886788992822,4cyclictest1003-21mta-sts-daemon08:40:511
886788992821,4cyclictest907637-21unixbench_multi08:15:501
886788992820,5cyclictest906289-21systemd-run08:15:021
886788992819,6cyclictest420-21avahi-daemon08:47:351
886788992812,2cyclictest171rcu_preempt11:30:401
886787992820,5cyclictest0-21swapper/009:10:000
886787992820,5cyclictest0-21swapper/009:10:000
886787992819,6cyclictest890454-21kernelversion07:20:350
886787992816,5cyclictest889762-21cron07:20:000
886789992720,4cyclictest1000-21mta-sts-daemon10:45:092
88678899276,5cyclictest28-21ksoftirqd/107:15:371
88678899275,6cyclictest28-21ksoftirqd/108:20:311
886788992720,4cyclictest888199-21unixbench_singl07:10:521
886789992619,4cyclictest912339-21latency_hist08:35:022
886789992618,5cyclictest907767-21munin-run08:20:012
886789992617,6cyclictest439-21systemd-logind08:50:012
88678899262,16cyclictest1029773-21ntpq12:05:401
88678899262,16cyclictest1029773-21ntpq12:05:401
886787992620,4cyclictest0-21swapper/008:20:010
886787992619,5cyclictest898725-21head07:45:500
886787992619,5cyclictest897251-21kworker/u8:8-nfsiod08:35:350
886789992516,5cyclictest895643-21unixbench_multi07:35:492
886787992519,3cyclictest0-21swapper/007:55:010
88679099242,12cyclictest0-21swapper/312:15:433
886787992418,3cyclictest0-21swapper/008:50:410
886787992417,5cyclictest627-21lldpd08:30:390
886787992413,3cyclictest0-21swapper/008:30:010
886787992213,7cyclictest897202-21unixbench_singl07:40:520
886787992212,8cyclictest872637-21kworker/u8:4+xprtiod07:30:010
88678799221,18cyclictest908657-21ntpq08:20:410
88679099214,11cyclictest0-21swapper/310:40:433
88679099214,11cyclictest0-21swapper/310:40:433
88679099213,10cyclictest0-21swapper/311:10:403
88679099212,12cyclictest0-21swapper/312:30:433
886787992115,4cyclictest904657-21tail08:05:500
886787992115,4cyclictest1001-21mta-sts-daemon08:40:310
88679099206,9cyclictest0-21swapper/310:10:443
88679099203,12cyclictest0-21swapper/311:00:453
88679099202,11cyclictest0-21swapper/309:30:433
88679099201,12cyclictest0-21swapper/311:25:443
886789992015,2cyclictest0-21swapper/207:10:012
886789992015,2cyclictest0-21swapper/207:10:012
88679099193,10cyclictest0-21swapper/309:10:423
88679099192,9cyclictest0-21swapper/309:35:443
88679099192,10cyclictest0-21swapper/309:25:413
88679099191,11cyclictest0-21swapper/312:20:453
88679099183,10cyclictest0-21swapper/310:35:453
88679099182,9cyclictest0-21swapper/312:35:433
88679099182,9cyclictest0-21swapper/312:00:473
88679099182,9cyclictest0-21swapper/310:50:463
88679099182,9cyclictest0-21swapper/310:50:463
88679099182,9cyclictest0-21swapper/310:25:363
88679099182,11cyclictest0-21swapper/312:05:503
88679099182,11cyclictest0-21swapper/312:05:503
88679099182,11cyclictest0-21swapper/311:05:393
88679099182,10cyclictest0-21swapper/309:55:453
88679099181,11cyclictest0-21swapper/310:15:453
88679099173,9cyclictest0-21swapper/312:25:463
88679099173,10cyclictest0-21swapper/309:15:573
88679099172,9cyclictest0-21swapper/311:50:443
88679099172,9cyclictest0-21swapper/311:20:443
88679099172,9cyclictest0-21swapper/310:55:393
88679099172,9cyclictest0-21swapper/310:20:403
88679099172,9cyclictest0-21swapper/309:45:383
88679099172,9cyclictest0-21swapper/307:35:443
88679099172,7cyclictest0-21swapper/308:45:433
88679099172,10cyclictest0-21swapper/311:45:423
88679099172,10cyclictest0-21swapper/311:30:423
88679099171,8cyclictest0-21swapper/308:25:393
88679099171,7cyclictest0-21swapper/307:10:423
88679099164,8cyclictest0-21swapper/310:05:413
88679099163,9cyclictest0-21swapper/311:55:373
88679099163,7cyclictest0-21swapper/308:05:013
88679099163,7cyclictest0-21swapper/308:05:013
88679099163,10cyclictest0-21swapper/308:15:383
88679099162,9cyclictest0-21swapper/311:15:413
88679099162,9cyclictest0-21swapper/309:20:423
88679099161,9cyclictest0-21swapper/311:35:453
88679099161,9cyclictest0-21swapper/309:40:453
88679099161,8cyclictest0-21swapper/308:10:393
88679099161,11cyclictest0-21swapper/310:00:413
88678799168,5cyclictest12650irq/32-eth007:10:010
88678799168,5cyclictest12650irq/32-eth007:10:010
88679099152,9cyclictest0-21swapper/312:10:373
88679099152,9cyclictest0-21swapper/311:40:323
88679099152,9cyclictest0-21swapper/310:30:403
88679099152,7cyclictest0-21swapper/309:50:303
88679099152,7cyclictest0-21swapper/308:10:013
88679099152,6cyclictest0-21swapper/309:05:373
88679099152,6cyclictest0-21swapper/309:05:373
88679099151,9cyclictest0-21swapper/310:45:163
88679099151,7cyclictest0-21swapper/309:00:463
88679099151,7cyclictest0-21swapper/309:00:463
88679099151,7cyclictest0-21swapper/308:35:383
88679099151,7cyclictest0-21swapper/307:25:413
88679099142,6cyclictest0-21swapper/308:55:393
88679099141,7cyclictest0-21swapper/308:50:463
88679099133,4cyclictest0-21swapper/308:20:353
88679099132,7cyclictest0-21swapper/307:15:383
88679099131,7cyclictest0-21swapper/308:40:373
88679099131,7cyclictest0-21swapper/307:50:393
88679099131,7cyclictest0-21swapper/307:20:413
88679099125,5cyclictest0-21swapper/307:30:343
88679099122,5cyclictest0-21swapper/307:40:393
88679099121,7cyclictest0-21swapper/308:30:403
88679099121,7cyclictest0-21swapper/307:45:373
88679099121,6cyclictest0-21swapper/307:55:393
8867909982,4cyclictest0-21swapper/307:10:013
8867909982,4cyclictest0-21swapper/307:10:013
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional