You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-06 - 18:25

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #2, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack2slot7s.osadl.org (updated Thu Aug 06, 2026 12:43:05)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1390055996959,4cyclictest0-21swapper/207:20:032
1390054995844,8cyclictest1426074-21diskmemload11:56:011
1390055995745,4cyclictest0-21swapper/210:10:582
1390055995042,5cyclictest1493174-21systemd-run11:00:022
1390055995042,5cyclictest1493174-21systemd-run11:00:022
1390054994636,6cyclictest1438323-21ssh09:30:011
139005499461,34cyclictest1521777-21ssh11:45:541
1390054994537,5cyclictest1441366-21ssh09:35:001
1390054994528,11cyclictest421-21dbus-daemon10:31:031
1390054994436,5cyclictest1514471-21ssh11:35:001
1390054994436,5cyclictest1514471-21ssh11:35:001
1390054994436,3cyclictest0-21swapper/109:10:511
1390054994436,3cyclictest0-21swapper/109:10:511
1390053994320,14cyclictest171rcu_preempt08:11:030
1390055994231,8cyclictest1416383-21needreboot08:35:502
1390054994234,5cyclictest421-21dbus-daemon08:55:021
1390054994234,5cyclictest1397606-21systemd-run07:35:011
1390054994234,5cyclictest1-21systemd08:10:011
1390054994233,6cyclictest1-21systemd09:50:011
1390053994233,5cyclictest0-21swapper/010:15:510
1390055994133,5cyclictest1553783-21ls12:40:012
1390055994133,5cyclictest1553783-21ls12:40:012
1390054994133,5cyclictest265-21systemd-journal11:00:011
1390054994133,5cyclictest265-21systemd-journal11:00:011
1390054994033,3cyclictest0-21swapper/112:15:011
1390054994029,8cyclictest1399074-21latency_hist07:40:011
1390053994029,5cyclictest12750irq/33-eth010:05:540
1390053994026,11cyclictest1450534-21ssh09:50:010
1390053994026,11cyclictest1427704-21timerwakeupswit09:11:040
1390053994026,11cyclictest1427704-21timerwakeupswit09:11:040
1390053994024,11cyclictest1000-21mta-sts-daemon12:05:530
1390053994023,14cyclictest1447504-21/usr/sbin/munin09:45:020
1390055993931,4cyclictest0-21swapper/209:30:532
1390055993929,8cyclictest1485604-21timerwakeupswit10:46:032
1390054993932,4cyclictest0-21swapper/110:15:531
1390053993932,5cyclictest611083-21cups-browsed08:45:540
1390053993926,6cyclictest1412588-21munin-run08:25:010
139005399392,28cyclictest1451757-21ssh09:50:530
139005399391,33cyclictest1515650-21ssh11:35:520
139005399391,29cyclictest1479085-21ssh10:35:540
139005599383,28cyclictest1494284-21ssh11:00:522
1390055993830,5cyclictest1426074-21diskmemload09:45:012
1390055993829,6cyclictest1-21systemd11:15:012
1390055993828,6cyclictest611083-21cups-browsed11:22:502
1390055993828,6cyclictest611083-21cups-browsed11:22:502
1390055993828,6cyclictest1536797-21ntpq12:10:502
1390054993829,5cyclictest1524825-21/usr/sbin/munin11:50:551
1390054993827,7cyclictest611083-21cups-browsed12:07:471
1390054993825,10cyclictest1519050-21switchtime11:41:051
1390053993830,5cyclictest1470478-21grep10:21:030
1390053993824,5cyclictest0-21swapper/008:25:550
1390053993824,5cyclictest0-21swapper/008:25:550
139005399382,31cyclictest151ktimers/010:40:520
1390055993728,5cyclictest1549447-21unixbench_multi12:31:042
139005599372,28cyclictest1479027-21ssh10:35:522
1390054993729,4cyclictest0-21swapper/111:20:551
1390054993729,4cyclictest0-21swapper/111:20:551
1390054993727,5cyclictest0-21swapper/109:25:021
1390054993727,5cyclictest0-21swapper/109:25:021
1390054993726,4cyclictest1456703-21latency_hist10:00:021
1390053993727,7cyclictest1441943-21aten_r2power_po09:35:420
1390053993724,4cyclictest1513162-21unixbench_multi11:31:030
1390053993724,4cyclictest1513162-21unixbench_multi11:31:030
1390055993628,5cyclictest1490125-21systemd10:55:022
1390055993628,5cyclictest1402153-21latency_hist07:50:022
1390055993623,10cyclictest1515474-21missed_timers11:35:472
139005399363,22cyclictest1536848-21ssh12:10:530
1390053993628,6cyclictest1477942-21sh10:35:010
1390053993627,6cyclictest421-21dbus-daemon09:31:010
1390053993627,6cyclictest1399120-21unin-run07:40:010
1390055993527,5cyclictest1542489-21fschecks_count12:20:442
1390055993527,5cyclictest1408035-21unixbench_singl08:06:052
1390055993527,5cyclictest1405623-21fschecks_time08:00:452
1390055993526,6cyclictest611083-21cups-browsed11:19:312
1390055993526,6cyclictest611083-21cups-browsed10:05:202
1390055993526,6cyclictest1442426-21needreboot09:35:482
1390055993524,8cyclictest1395501-21ntp_kernel_pll_07:25:542
139005499355,21cyclictest421-21dbus-daemon08:25:551
139005499355,21cyclictest421-21dbus-daemon08:25:551
1390054993526,6cyclictest420-21avahi-daemon07:10:011
1390054993526,4cyclictest0-21swapper/108:45:541
1390054993525,6cyclictest420-21avahi-daemon11:19:311
139005399353,21cyclictest12650irq/32-eth008:40:530
1390053993528,4cyclictest420-21avahi-daemon11:20:480
1390053993528,4cyclictest420-21avahi-daemon11:20:480
1390053993528,3cyclictest0-21swapper/007:45:010
1390053993526,6cyclictest611083-21cups-browsed11:45:470
1390053993525,6cyclictest1433497-21ssh09:21:020
1390053993525,6cyclictest1433497-21ssh09:21:020
139005399352,25cyclictest1542945-21ssh12:20:550
139005599345,16cyclictest1482162-21ssh10:40:532
1390055993427,4cyclictest1497798-21timerwakeupswit11:06:032
1390055993425,6cyclictest420-21avahi-daemon09:51:572
1390055993419,5cyclictest1456469-21ssh09:59:372
1390054993428,3cyclictest0-21swapper/110:55:011
1390054993426,5cyclictest439-21systemd-logind07:55:011
1390054993426,5cyclictest1426111-21latency_hist09:10:021
1390054993425,7cyclictest1405069-21munin-run08:00:011
1390054993425,5cyclictest1432183-21cron09:20:001
1390053993427,5cyclictest611083-21cups-browsed08:50:190
1390053993425,6cyclictest1426074-21diskmemload10:01:070
1390053993425,5cyclictest0-21swapper/011:05:560
1390053993422,5cyclictest1395621-21proc_pri07:25:580
139005399341,28cyclictest1454707-21ssh09:55:560
1390055993326,4cyclictest1530776-21needreboot12:00:532
1390055993325,5cyclictest1427126-21needreboot09:10:492
1390055993325,5cyclictest1427126-21needreboot09:10:492
1390055993325,5cyclictest1-21systemd09:30:012
139005599332,26cyclictest1470140-21grep10:20:582
1390054993327,3cyclictest0-21swapper/112:20:011
1390054993327,3cyclictest0-21swapper/109:36:041
1390054993325,5cyclictest265-21systemd-journal08:15:011
1390054993325,5cyclictest1484013-21cron10:45:011
1390054993325,5cyclictest1463766-21needreboot10:10:481
1390054993325,5cyclictest1462699-21ssh10:10:001
1390054993325,5cyclictest1418515-21unixbench_singl08:41:041
1390054993325,5cyclictest1411074-21munin-run08:20:011
139005499332,22cyclictest1445611-21ssh09:40:531
1390053993327,3cyclictest1553834-21kworker/u8:5-xprtiod12:40:030
1390053993327,3cyclictest1553834-21kworker/u8:5-xprtiod12:40:030
1390053993327,3cyclictest0-21swapper/011:15:460
1390053993326,5cyclictest0-21swapper/010:15:020
1390053993326,4cyclictest1426272-21latency_hist09:10:030
1390053993325,5cyclictest1530143-21/usr/sbin/munin12:00:490
1390053993324,7cyclictest1423063-21munin-plugin-st09:00:020
1390053993321,10cyclictest0-21swapper/012:00:020
1390053993311,15cyclictest12750irq/33-eth007:20:030
139005599327,4cyclictest36-21ksoftirqd/211:45:522
1390055993225,3cyclictest0-21swapper/209:21:032
1390055993225,3cyclictest0-21swapper/209:21:032
1390055993224,5cyclictest1412581-21sh08:25:002
1390055993224,4cyclictest0-21swapper/212:06:002
1390055993214,3cyclictest171rcu_preempt09:45:442
1390054993226,3cyclictest0-21swapper/112:40:011
1390054993226,3cyclictest0-21swapper/112:40:011
1390054993225,4cyclictest1499993-21uniq11:10:451
1390054993225,4cyclictest1485180-21ntp_kernel_pll_10:45:531
1390054993225,4cyclictest1396021-21head07:26:031
1390054993224,5cyclictest611083-21cups-browsed11:00:371
1390053993225,4cyclictest1001-21mta-sts-daemon09:26:270
1390053993224,4cyclictest0-21swapper/010:25:430
139005599319,6cyclictest36-21ksoftirqd/211:30:532
139005599319,6cyclictest36-21ksoftirqd/211:30:532
1390055993125,3cyclictest0-21swapper/211:51:282
1390055993125,3cyclictest0-21swapper/208:45:002
1390055993124,4cyclictest1414724-21kernelversion08:30:462
1390055993124,4cyclictest1414724-21kernelversion08:30:462
139005599312,21cyclictest1473028-21ssh10:25:542
1390055993120,8cyclictest1413491-21ntp_kernel_pll_08:25:522
1390055993120,8cyclictest1413491-21ntp_kernel_pll_08:25:522
1390054993126,2cyclictest0-21swapper/107:45:011
1390054993125,3cyclictest0-21swapper/111:35:521
1390054993125,3cyclictest0-21swapper/110:01:061
1390054993124,4cyclictest1511478-21latency_hist11:30:011
1390054993124,4cyclictest1511478-21latency_hist11:30:011
1390054993124,4cyclictest1001-21mta-sts-daemon11:05:471
139005499311,24cyclictest1451774-21ssh09:50:541
139005499311,23cyclictest1543097-21rm12:20:591
1390053993125,4cyclictest1405074-21basename08:00:010
1390053993124,5cyclictest421-21dbus-daemon11:15:010
139005599309,4cyclictest36-21ksoftirqd/207:56:002
139005599308,8cyclictest1426074-21diskmemload10:02:502
139005599308,4cyclictest36-21ksoftirqd/207:20:532
139005599307,4cyclictest36-21ksoftirqd/210:15:512
139005599307,4cyclictest36-21ksoftirqd/209:05:572
139005599305,7cyclictest36-21ksoftirqd/208:55:492
1390055993025,2cyclictest0-21swapper/212:30:012
1390055993024,3cyclictest0-21swapper/212:20:012
1390055993023,4cyclictest1391531-21sh07:15:012
1390055993023,3cyclictest0-21swapper/211:45:032
1390055993011,4cyclictest36-21ksoftirqd/208:10:552
1390054993024,3cyclictest0-21swapper/108:25:001
1390054993023,4cyclictest1392936-21unixbench_multi07:16:041
1390054993022,5cyclictest420-21avahi-daemon10:25:091
1390054993022,5cyclictest1546661-21kworker/u8:1+xprtiod12:35:021
139005399303,17cyclictest1524860-21ssh11:50:570
1390053993024,4cyclictest1548489-21fschecks_count12:30:450
1390053993023,4cyclictest1417083-21idleruntime-cro08:40:000
1390053993020,6cyclictest420-21avahi-daemon10:51:590
1390053993011,14cyclictest1490408-21sshd10:55:190
1390053993011,14cyclictest1490408-21sshd10:55:190
1390055992920,6cyclictest1421568-21cron08:55:012
1390055992916,7cyclictest341rcuc/207:10:022
1390055992912,9cyclictest1528690-21ssh11:56:522
1390054992925,2cyclictest0-21swapper/107:15:011
1390054992924,2cyclictest0-21swapper/107:45:431
1390054992921,5cyclictest1545800-21needreboot12:25:491
1390053992924,3cyclictest1003-21mta-sts-daemon09:15:140
139005399292,19cyclictest12650irq/32-eth011:25:570
139005399292,19cyclictest12650irq/32-eth011:25:570
1390053992921,5cyclictest611083-21cups-browsed11:44:410
1390053992919,8cyclictest1423892-21needreboot09:00:490
1390053992910,15cyclictest1485152-21sh10:45:520
1390055992822,3cyclictest0-21swapper/209:15:392
1390054992820,5cyclictest1469762-21latency10:20:471
1390054992820,5cyclictest1406474-21unixbench_multi08:01:051
1390053992822,4cyclictest1529741-21kworker/u8:14-rpciod12:25:470
1390053992822,4cyclictest1402604-21fschecks_count07:50:470
1390053992822,3cyclictest0-21swapper/012:20:020
1390053992821,5cyclictest611083-21cups-browsed08:30:520
1390053992821,5cyclictest611083-21cups-browsed08:30:520
1390053992821,5cyclictest1-21systemd08:17:440
1390053992821,4cyclictest1396614-21fschecks_count07:30:430
1390053992818,7cyclictest0-21swapper/011:05:010
1390055992720,4cyclictest1402598-21sort07:50:472
1390055992720,4cyclictest0-21swapper/209:05:012
1390055992719,4cyclictest351ktimers/211:25:362
1390055992719,4cyclictest351ktimers/211:25:362
1390055992718,6cyclictest611083-21cups-browsed08:15:492
1390055992718,6cyclictest0-21swapper/210:30:452
1390055992716,3cyclictest171rcu_preempt07:30:452
1390055992713,3cyclictest171rcu_preempt07:40:562
1390054992720,4cyclictest1417105-21systemd-run08:40:011
1390054992718,3cyclictest0-21swapper/112:01:001
1390054992715,9cyclictest1478350-21/usr/sbin/munin10:35:451
1390054992713,10cyclictest420-21avahi-daemon07:20:541
1390055992620,3cyclictest0-21swapper/208:45:442
1390055992619,5cyclictest0-21swapper/207:40:012
1390054992619,4cyclictest1424734-21latency_hist09:05:031
1390053992619,5cyclictest611059-21cupsd07:22:560
1390054992517,5cyclictest1415568-21latency_hist08:35:011
1390054992517,5cyclictest1415568-21latency_hist08:35:011
1390053992520,2cyclictest0-21swapper/008:05:500
1390053992519,4cyclictest1391380-21unixbench-2d07:11:010
1390054992418,3cyclictest0-21swapper/109:00:011
1390053992318,3cyclictest1000-21mta-sts-daemon07:45:480
139005399221,18cyclictest1406045-21ntpq08:00:570
139005699203,9cyclictest0-21swapper/312:05:543
1390053992013,4cyclictest12750irq/33-eth007:10:010
139005699194,9cyclictest0-21swapper/309:45:583
139005699182,10cyclictest0-21swapper/309:40:523
139005699172,9cyclictest0-21swapper/311:40:593
139005699163,8cyclictest0-21swapper/310:10:583
139005699163,7cyclictest0-21swapper/309:50:533
139005699162,9cyclictest0-21swapper/309:55:583
139005699162,8cyclictest0-21swapper/311:10:583
139005699161,9cyclictest0-21swapper/310:20:503
139005699161,8cyclictest0-21swapper/311:55:573
139005699161,10cyclictest0-21swapper/311:15:553
139005699154,5cyclictest0-21swapper/310:45:583
139005699153,8cyclictest0-21swapper/312:20:533
139005699153,6cyclictest0-21swapper/311:05:543
139005699152,9cyclictest0-21swapper/310:25:543
139005699151,8cyclictest0-21swapper/311:35:503
139005699151,6cyclictest0-21swapper/308:40:533
139005699147,4cyclictest0-21swapper/309:25:413
139005699143,7cyclictest0-21swapper/309:35:533
139005699143,6cyclictest0-21swapper/312:35:503
139005699143,6cyclictest0-21swapper/312:35:503
139005699143,6cyclictest0-21swapper/311:30:503
139005699143,6cyclictest0-21swapper/311:30:503
139005699143,6cyclictest0-21swapper/310:05:523
139005699143,4cyclictest0-21swapper/308:20:543
139005699142,8cyclictest0-21swapper/312:15:423
139005699142,8cyclictest0-21swapper/310:50:563
139005699142,8cyclictest0-21swapper/309:15:453
139005699142,7cyclictest0-21swapper/311:45:513
139005699142,7cyclictest0-21swapper/309:30:523
139005699142,7cyclictest0-21swapper/309:20:463
139005699142,7cyclictest0-21swapper/309:20:463
139005699142,7cyclictest0-21swapper/309:10:513
139005699142,7cyclictest0-21swapper/309:10:513
139005699142,5cyclictest0-21swapper/307:55:533
139005699141,9cyclictest0-21swapper/310:30:543
139005699141,8cyclictest0-21swapper/311:00:533
139005699141,8cyclictest0-21swapper/310:00:523
139005699141,7cyclictest0-21swapper/312:30:413
139005699141,7cyclictest0-21swapper/311:20:523
139005699141,7cyclictest0-21swapper/311:20:523
139005699141,6cyclictest0-21swapper/307:40:493
139005699134,5cyclictest0-21swapper/307:20:543
139005699133,6cyclictest0-21swapper/310:35:573
139005699132,7cyclictest0-21swapper/312:00:553
139005699132,7cyclictest0-21swapper/309:05:573
139005699131,8cyclictest0-21swapper/310:55:443
139005699131,8cyclictest0-21swapper/310:55:443
139005699131,7cyclictest0-21swapper/309:00:513
139005699131,6cyclictest0-21swapper/311:50:403
139005699131,6cyclictest0-21swapper/310:15:413
139005699131,6cyclictest0-21swapper/307:20:033
139005699126,4cyclictest0-21swapper/308:50:023
139005699126,4cyclictest0-21swapper/308:06:043
139005699126,4cyclictest0-21swapper/307:26:033
139005699125,4cyclictest0-21swapper/307:40:023
139005699123,6cyclictest0-21swapper/312:10:533
139005699121,8cyclictest0-21swapper/308:05:023
139005699121,7cyclictest0-21swapper/312:25:423
139005699121,5cyclictest0-21swapper/307:30:493
139005699115,4cyclictest0-21swapper/310:40:443
139005699115,4cyclictest0-21swapper/307:55:023
139005699112,6cyclictest0-21swapper/308:25:553
139005699112,6cyclictest0-21swapper/308:25:553
139005699112,6cyclictest0-21swapper/308:10:453
139005699112,5cyclictest0-21swapper/311:25:393
139005699112,5cyclictest0-21swapper/311:25:393
139005699111,6cyclictest0-21swapper/309:00:013
139005699111,6cyclictest0-21swapper/308:35:513
139005699110,5cyclictest0-21swapper/308:15:483
139005699101,6cyclictest0-21swapper/308:50:453
139005699101,6cyclictest0-21swapper/308:30:513
139005699101,6cyclictest0-21swapper/308:30:513
139005699101,6cyclictest0-21swapper/307:10:013
139005699101,4cyclictest0-21swapper/307:10:503
13900569981,5cyclictest0-21swapper/307:45:423
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional