You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-19 - 06:41

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #2, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack2slot7s.osadl.org (updated Fri Jun 19, 2026 00:43:28)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2736577997263,5cyclictest2885269-21grep00:10:242
2736576995143,4cyclictest0-21swapper/100:00:011
2736576994941,5cyclictest2759094-21systemd-run20:25:011
2736577994638,5cyclictest2813700-21ssh22:15:212
2736577994539,3cyclictest0-21swapper/200:20:232
2736577994537,7cyclictest0-21swapper/223:20:282
2736577994537,5cyclictest2850312-21idleruntime-cro23:15:012
2736577994437,3cyclictest0-21swapper/221:20:012
2736575994420,19cyclictest151ktimers/020:05:290
2736577994337,3cyclictest0-21swapper/220:20:012
2736577994335,5cyclictest0-21swapper/219:20:002
2736577994335,5cyclictest0-21swapper/219:20:002
2736575994315,23cyclictest2879198-21ssh00:00:320
2736577994233,6cyclictest421-21dbus-daemon23:40:022
2736576994233,6cyclictest2792291-21needreboot21:40:271
273657599426,30cyclictest421-21dbus-daemon23:50:350
2736577994133,5cyclictest2751598-21latency_hist20:00:022
2736577994124,11cyclictest567-21gdbus00:35:302
2736576994132,6cyclictest2884561-21latency_hist00:10:021
2736576994130,6cyclictest2776751-21ssh21:15:301
273657599411,30cyclictest2888538-21ssh00:15:290
2736577994032,6cyclictest351ktimers/219:30:292
2736577994031,6cyclictest2878571-21aten_r2power_fr00:00:182
2736577994030,6cyclictest2781984-21systemd-run21:25:022
2736576994032,5cyclictest2810009-21systemd-run22:10:021
2736576994030,5cyclictest0-21swapper/100:30:281
273657799393,29cyclictest2826589-21ssh22:35:322
273657799393,29cyclictest2826589-21ssh22:35:322
2736577993932,4cyclictest0-21swapper/223:55:022
2736577993930,6cyclictest420-21avahi-daemon21:36:002
273657799391,32cyclictest2817235-21ssh22:20:282
2736575993931,5cyclictest151ktimers/000:25:300
2736575993914,17cyclictest12650irq/32-eth023:35:320
273657799383,26cyclictest2882362-21ssh00:05:322
2736577993829,5cyclictest2858468-21sh23:26:342
2736577993829,5cyclictest2801098-21aten_r2power_po21:55:182
2736577993826,8cyclictest420-21avahi-daemon21:10:322
2736576993829,5cyclictest2800675-21ssh21:55:021
2736576993829,4cyclictest0-21swapper/100:10:281
273657699381,32cyclictest2848240-21ssh23:10:281
2736575993831,4cyclictest0-21swapper/000:40:010
2736575993825,7cyclictest151ktimers/019:40:350
273657599382,33cyclictest2854433-21ssh23:20:270
2736577993729,5cyclictest2894382-21gltestperf00:25:232
2736577993728,6cyclictest420-21avahi-daemon21:00:022
273657799372,26cyclictest2811029-21ssh22:10:292
273657799372,25cyclictest2792340-21ssh21:40:282
2736576993730,4cyclictest2834831-21systemd22:50:011
2736576993729,5cyclictest1-21systemd19:45:021
2736576993729,4cyclictest0-21swapper/121:55:361
2736575993731,4cyclictest2775724-21ssh21:15:020
2736575993731,4cyclictest2758216-21sshd20:20:220
2736575993730,4cyclictest1003-21mta-sts-daemon22:49:180
273657799363,25cyclictest2795545-21ssh21:45:312
2736577993626,4cyclictest0-21swapper/222:57:452
2736577993617,13cyclictest351ktimers/223:30:262
2736576993630,3cyclictest0-21swapper/123:50:021
2736576993629,4cyclictest2788832-21fschecks_time21:35:211
2736576993629,3cyclictest0-21swapper/122:20:251
2736576993628,5cyclictest2813111-21systemd-run22:15:021
2736575993630,4cyclictest1002-21mta-sts-daemon00:34:490
2736575993627,7cyclictest421-21dbus-daemon23:55:430
2736575993626,4cyclictest0-21swapper/021:50:290
2736577993529,3cyclictest0-21swapper/200:20:012
2736577993528,4cyclictest0-21swapper/221:25:252
2736577993527,5cyclictest2844232-21latency_hist23:05:022
2736577993511,17cyclictest420-21avahi-daemon20:50:352
273657699355,24cyclictest2863763-21ssh23:35:301
2736576993528,4cyclictest2889094-21unixbench_multi00:15:411
2736576993527,5cyclictest2828607-21ssh22:40:001
2736576993527,5cyclictest2828607-21ssh22:40:001
2736576993526,7cyclictest2757559-21sendmail20:20:011
273657699352,28cyclictest2773548-21ssh21:10:271
2736575993530,3cyclictest0-21swapper/020:20:010
2736575993529,4cyclictest1-21systemd23:20:020
2736575993529,2cyclictest0-21swapper/021:55:280
2736575993527,4cyclictest2823026-21fschecks_count22:30:210
2736575993518,10cyclictest12650irq/32-eth022:05:280
273657799346,5cyclictest171rcu_preempt23:05:302
2736577993427,4cyclictest2847238-21kworker/u8:4-xprtiod00:00:012
2736577993425,6cyclictest1-21systemd20:45:022
2736577993424,5cyclictest0-21swapper/222:02:252
2736577993424,4cyclictest0-21swapper/223:15:322
273657799342,20cyclictest2786214-21ssh21:30:342
2736577993419,9cyclictest351ktimers/219:40:292
2736576993427,4cyclictest2841003-21cron23:00:011
2736576993426,3cyclictest0-21swapper/123:05:301
273657699341,29cyclictest2879144-21ssh00:00:271
2736575993428,4cyclictest2744330-21aten_r2power_cu19:35:170
2736575993424,4cyclictest12750irq/33-eth020:00:300
2736575993423,8cyclictest2796029-21unixbench_multi21:45:400
273657799335,19cyclictest2866863-21ssh23:40:382
273657799333,22cyclictest2823487-21ssh22:30:312
2736577993325,5cyclictest2820511-21processes22:25:342
273657799332,4cyclictest171rcu_preempt22:50:302
2736576993328,2cyclictest0-21swapper/121:10:011
2736576993326,4cyclictest0-21swapper/123:50:351
2736576993325,5cyclictest2837896-21cron22:55:001
2736576993325,5cyclictest2831804-21latency_hist22:45:021
2736576993325,5cyclictest2786525-21grep21:30:411
2736576993325,4cyclictest2797696-21latency_hist21:50:031
2736576993324,4cyclictest0-21swapper/122:00:291
2736575993327,4cyclictest2767070-21fschecks_count20:50:220
2736575993326,4cyclictest2819310-21munin-plugin-st22:25:020
2736575993326,4cyclictest2810590-21fschecks_count22:10:210
2736575993326,3cyclictest1001-21mta-sts-daemon21:25:020
2736575993321,7cyclictest151ktimers/019:10:270
2736575993321,7cyclictest151ktimers/019:10:270
273657599331,28cyclictest665-21snmpd22:00:320
273657799325,15cyclictest1000-21mta-sts-daemon23:45:322
2736577993227,2cyclictest0-21swapper/220:05:282
2736577993225,3cyclictest0-21swapper/222:05:292
2736577993224,5cyclictest2736588-21systemd-run19:10:012
2736577993224,5cyclictest2736588-21systemd-run19:10:012
2736577993224,4cyclictest2900085-21latency_hist00:35:032
2736577993222,7cyclictest2745329-21timerwakeupswit19:35:422
2736577993221,8cyclictest2770298-21missed_timers21:00:252
273657699325,18cyclictest428-21mta-sts-daemon19:45:311
2736576993227,2cyclictest0-21swapper/119:40:011
2736576993226,3cyclictest0-21swapper/123:15:351
2736576993226,3cyclictest0-21swapper/100:25:231
2736576993224,5cyclictest993117-21cups-browsed20:55:191
2736576993224,4cyclictest0-21swapper/123:40:411
2736575993227,3cyclictest2841387-21aten_r2power_en23:00:160
2736575993224,4cyclictest151ktimers/021:30:310
2736575993212,11cyclictest151ktimers/000:10:330
2736577993123,5cyclictest2738209-21latency_hist19:15:022
2736577993123,5cyclictest2738209-21latency_hist19:15:022
2736577993122,6cyclictest487-21rs:main2
2736577993122,3cyclictest0-21swapper/221:50:202
2736577993120,6cyclictest2741078-21munin-run19:25:002
273657699317,18cyclictest2823398-21ssh22:30:271
273657699313,22cyclictest1000-21mta-sts-daemon20:10:271
2736576993124,4cyclictest2893749-21systemd-run00:25:011
2736575993111,13cyclictest12650irq/32-eth021:35:270
2736577993026,3cyclictest2736574-21cyclictest20:40:022
2736577993023,4cyclictest1001-21mta-sts-daemon21:05:312
273657799302,19cyclictest2832782-21ssh22:45:302
2736576993024,3cyclictest2756072-21kworker/u8:4-nfsiod21:25:011
2736576993023,4cyclictest2822530-21latency_hist22:30:031
2736576993023,4cyclictest2763557-21munin-run20:40:001
2736576993022,5cyclictest2765058-21cron20:45:011
273657599303,18cyclictest2772561-21diskmemload23:10:300
2736575993020,7cyclictest0-21swapper/020:35:000
2736575993017,7cyclictest12650irq/32-eth023:45:340
2736575993017,11cyclictest0-21swapper/022:55:010
2736575993011,15cyclictest2768073-21kworker/u8:2+rpciod21:00:280
273657599300,25cyclictest0-21swapper/000:05:340
273657799294,14cyclictest421-21dbus-daemon20:10:322
2736577992922,4cyclictest1000-21mta-sts-daemon19:45:332
2736577992911,11cyclictest2829947-21/usr/sbin/munin22:40:382
2736576992922,3cyclictest0-21swapper/123:20:301
2736576992921,5cyclictest2813464-21tail22:15:171
2736576992921,5cyclictest2766454-21tail20:45:401
2736576992920,7cyclictest2751570-21sendmail20:00:011
2736575992923,4cyclictest2739603-21systemd-run19:20:010
2736575992923,4cyclictest2739603-21systemd-run19:20:010
2736575992923,4cyclictest1001-21mta-sts-daemon23:32:260
2736575992922,5cyclictest2776625-21needreboot21:15:250
2736575992922,4cyclictest2736715-21latency_hist19:10:020
2736575992922,4cyclictest2736715-21latency_hist19:10:020
2736575992921,6cyclictest2794636-21latency_hist21:45:030
2736575992920,5cyclictest12750irq/33-eth000:20:340
2736575992920,4cyclictest0-21swapper/022:55:290
2736577992821,4cyclictest1003-21mta-sts-daemon20:30:192
2736577992820,5cyclictest2753083-21systemd-run20:05:012
2736576992822,3cyclictest1001-21mta-sts-daemon00:37:461
2736576992822,3cyclictest0-21swapper/123:25:341
2736575992823,3cyclictest2781979-21kworker/u8:14-nfsiod22:40:010
2736575992823,3cyclictest2781979-21kworker/u8:14-nfsiod22:40:010
2736575992818,5cyclictest151ktimers/020:55:310
2736575992817,7cyclictest2866860-21sh23:40:380
2736575992814,10cyclictest12650irq/32-eth022:17:480
273657599281,22cyclictest2759684-21ethtool20:25:220
273657599281,22cyclictest2759684-21ethtool20:25:220
2736577992720,5cyclictest351ktimers/220:20:292
2736575992723,2cyclictest0-21swapper/022:25:210
2736575992721,4cyclictest2783619-21unixbench_singl21:25:410
2736575992718,7cyclictest1001-21mta-sts-daemon22:40:350
2736575992716,6cyclictest12750irq/33-eth021:05:340
2736576992619,4cyclictest1001-21mta-sts-daemon21:26:441
2736576992619,3cyclictest0-21swapper/123:30:351
2736576992617,6cyclictest2842884-21ssh23:01:181
2736576992615,8cyclictest2753083-21systemd-run20:05:011
2736575992620,4cyclictest2755934-21tail20:10:370
2736575992615,8cyclictest2747907-21ntp_kernel_err19:45:260
2736577992519,3cyclictest0-21swapper/220:25:382
2736577992519,3cyclictest0-21swapper/220:25:382
2736577992518,4cyclictest0-21swapper/219:25:302
2736577992517,5cyclictest2749993-21unixbench_singl19:50:382
273657699255,14cyclictest1001-21mta-sts-daemon19:15:261
273657699255,14cyclictest1001-21mta-sts-daemon19:15:261
2736576992517,5cyclictest2738054-21cron19:15:001
2736576992517,5cyclictest2738054-21cron19:15:001
2736575992517,6cyclictest2857700-21ssh23:25:350
2736576992418,3cyclictest0-21swapper/119:35:011
2736576992417,4cyclictest2742490-21unixbench_singl19:25:381
2736576992416,5cyclictest2754582-21systemd-run20:10:011
2736575992419,3cyclictest2750597-21idleruntime19:55:200
2736575992418,4cyclictest993117-21cups-browsed20:41:250
2736575992413,7cyclictest12650irq/32-eth020:40:000
273657599241,18cyclictest2845317-21ps23:05:370
273657699232,15cyclictest443-21gpm20:30:271
2736576992316,3cyclictest0-21swapper/120:50:241
2736576992315,5cyclictest2750068-21systemd-run19:55:011
2736576992214,5cyclictest2740094-21grep19:20:191
273657599222,15cyclictest2766007-21ntpq20:45:320
2736575992216,3cyclictest0-21swapper/019:50:190
2736575992212,8cyclictest265-21systemd-journal19:21:230
273657899212,9cyclictest0-21swapper/323:55:363
273657699212,14cyclictest2770470-21ntpq21:00:311
2736576992114,4cyclictest2759405-21aten2.4-expect20:25:171
2736576992114,4cyclictest2759405-21aten2.4-expect20:25:171
273657599212,14cyclictest2741953-21ntpq19:25:270
2736575992116,3cyclictest0-21swapper/019:30:210
2736576992014,4cyclictest2726938-21kworker/u8:5-nfsiod19:10:011
2736576992014,4cyclictest2726938-21kworker/u8:5-nfsiod19:10:011
273657899192,10cyclictest0-21swapper/323:10:293
273657899192,10cyclictest0-21swapper/322:55:343
273657899183,8cyclictest0-21swapper/300:15:343
273657899182,8cyclictest0-21swapper/322:45:393
273657899182,8cyclictest0-21swapper/322:25:273
273657899181,9cyclictest0-21swapper/323:50:323
273657899173,6cyclictest0-21swapper/323:15:313
273657899172,9cyclictest0-21swapper/323:35:273
273657899172,7cyclictest0-21swapper/323:45:313
273657899172,6cyclictest0-21swapper/320:35:313
273657899171,9cyclictest0-21swapper/321:25:343
273657899171,9cyclictest0-21swapper/300:30:313
273657899171,8cyclictest0-21swapper/320:25:293
273657899171,8cyclictest0-21swapper/320:25:293
273657899171,8cyclictest0-21swapper/320:10:323
273657899171,8cyclictest0-21swapper/320:05:293
273657899171,7cyclictest0-21swapper/320:55:313
273657899171,6cyclictest0-21swapper/320:40:243
273657899171,5cyclictest0-21swapper/320:00:253
273657899164,9cyclictest0-21swapper/322:50:313
273657899163,6cyclictest0-21swapper/320:30:323
273657899162,7cyclictest0-21swapper/300:25:323
273657899161,8cyclictest0-21swapper/323:00:293
273657899161,8cyclictest0-21swapper/322:00:293
273657899161,8cyclictest0-21swapper/321:15:333
273657899161,8cyclictest0-21swapper/320:15:303
273657899161,6cyclictest0-21swapper/319:30:293
273657899161,10cyclictest0-21swapper/319:15:273
273657899161,10cyclictest0-21swapper/319:15:273
273657899154,6cyclictest0-21swapper/322:10:293
273657899153,9cyclictest0-21swapper/323:20:273
273657899153,8cyclictest0-21swapper/300:20:233
273657899153,7cyclictest0-21swapper/322:30:323
273657899152,8cyclictest0-21swapper/321:40:283
273657899152,5cyclictest0-21swapper/319:25:283
273657899151,7cyclictest0-21swapper/323:30:273
273657899151,7cyclictest0-21swapper/321:00:313
273657899151,7cyclictest0-21swapper/319:20:273
273657899151,6cyclictest0-21swapper/323:05:303
273657899151,6cyclictest0-21swapper/320:50:273
273657899151,6cyclictest0-21swapper/320:45:313
273657899151,6cyclictest0-21swapper/319:55:253
273657899143,7cyclictest0-21swapper/321:15:013
273657899143,6cyclictest0-21swapper/321:45:293
273657899143,6cyclictest0-21swapper/300:35:273
273657899142,8cyclictest0-21swapper/321:30:343
273657899142,7cyclictest0-21swapper/321:20:183
273657899142,7cyclictest0-21swapper/300:10:213
273657899142,7cyclictest0-21swapper/300:00:333
273657899142,6cyclictest0-21swapper/322:05:253
273657899141,8cyclictest0-21swapper/322:40:223
273657899141,7cyclictest0-21swapper/322:35:293
273657899141,7cyclictest0-21swapper/322:35:293
273657899141,7cyclictest0-21swapper/321:55:323
273657899141,7cyclictest0-21swapper/321:35:273
273657899141,7cyclictest0-21swapper/319:45:273
273657899133,5cyclictest0-21swapper/322:15:263
273657899132,6cyclictest0-21swapper/322:20:213
273657899131,7cyclictest0-21swapper/319:35:343
273657899131,6cyclictest0-21swapper/323:25:163
273657899131,6cyclictest0-21swapper/321:50:153
273657899121,7cyclictest0-21swapper/323:40:343
273657899121,7cyclictest0-21swapper/300:05:203
273657899121,6cyclictest0-21swapper/321:05:303
273657899121,6cyclictest0-21swapper/320:20:263
273657899121,6cyclictest0-21swapper/319:40:303
273657899111,4cyclictest0-21swapper/319:10:273
273657899111,4cyclictest0-21swapper/319:10:273
273657899101,5cyclictest0-21swapper/319:50:163
27365789971,3cyclictest0-21swapper/319:10:013
27365789971,3cyclictest0-21swapper/319:10:013
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional