You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-07 - 01:27

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #2, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack2slot7s.osadl.org (updated Sun Sep 06, 2026 12:42:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1471930995235,13cyclictest0-21swapper/010:50:000
1471930994943,4cyclictest1477944-21systemd-run07:30:010
147193199485,38cyclictest271ktimers/109:11:131
1471931994533,8cyclictest1632668-21idleruntime-cro12:35:011
1471932994435,6cyclictest421-21dbus-daemon08:25:012
1471930994434,7cyclictest1-21systemd08:50:010
1471932994336,4cyclictest1507926-21diskmemload10:25:012
1471931994334,6cyclictest421-21dbus-daemon10:05:021
1471932994231,8cyclictest1530331-21kernelversion09:46:032
1471931994234,4cyclictest1479403-21kworker/u8:2-xprtiod07:34:401
1471930994235,4cyclictest1515600-21switchtime09:21:180
1471932994132,6cyclictest1600407-21needreboot11:41:062
1471932994132,5cyclictest1508041-21latency_hist09:10:022
1471931994134,4cyclictest1544566-21kworker/u8:0-xprtiod11:10:011
1471931994133,5cyclictest1483871-21head07:46:181
1471932994030,6cyclictest420-21avahi-daemon11:53:182
1471932994030,6cyclictest420-21avahi-daemon11:53:182
1471932993931,5cyclictest1538456-21idleruntime-cro10:00:012
1471932993930,6cyclictest1597845-21wc11:36:192
1471931993934,3cyclictest0-21swapper/109:00:011
1471931993932,4cyclictest1473634-21kworker/u8:6-xprtiod08:00:011
1471930993932,4cyclictest1001-21mta-sts-daemon09:39:530
1471930993930,6cyclictest0-21swapper/008:20:010
1471931993830,5cyclictest1514022-21ssh09:20:011
1471931993830,3cyclictest0-21swapper/111:40:011
1471931993828,6cyclictest695189-21cups-browsed10:25:001
1471930993829,7cyclictest1533857-21mailstats09:51:200
1471931993730,3cyclictest0-21swapper/110:00:011
1471931993729,4cyclictest0-21swapper/110:36:121
147193199370,31cyclictest1600552-21ssh11:41:121
1471930993729,6cyclictest1479403-21kworker/u8:2-rpciod07:34:410
1471930993724,5cyclictest421-21dbus-daemon07:50:010
1471932993628,5cyclictest421-21dbus-daemon08:25:592
1471932993628,5cyclictest1588391-21ssh11:21:112
1471932993628,5cyclictest1578171-21latency_hist11:05:032
1471932993626,7cyclictest1506432-21munin-plugin-st09:05:022
1471931993628,5cyclictest1501935-21systemd-run08:50:011
1471931993628,5cyclictest1482423-21cron07:45:011
1471931993627,6cyclictest420-21avahi-daemon10:16:191
1471930993632,2cyclictest0-21swapper/009:11:120
1471930993631,3cyclictest1581043-21systemd11:10:020
1471930993629,4cyclictest1537201-21unixbench_multi09:56:200
1471930993628,5cyclictest1521148-21kernelversion09:31:040
1471932993527,5cyclictest695189-21cups-browsed09:38:522
1471932993527,5cyclictest1568994-21latency_hist10:50:022
1471932993526,6cyclictest421-21dbus-daemon12:36:022
1471932993525,7cyclictest1548729-21needreboot10:16:092
1471931993527,5cyclictest1572796-21if_wlan010:56:011
1471931993527,5cyclictest1528050-21unixbench-2d09:41:191
1471931993527,4cyclictest0-21swapper/109:40:011
1471931993526,6cyclictest420-21avahi-daemon09:27:421
1471930993530,2cyclictest0-21swapper/012:20:010
1471930993530,2cyclictest0-21swapper/011:01:010
1471930993528,5cyclictest1605326-21cron11:50:000
1471930993528,5cyclictest1605326-21cron11:50:000
1471930993528,5cyclictest1570323-21mailstats10:51:170
1471930993528,4cyclictest1562714-21kworker/u8:6+xprtiod10:45:010
1471932993427,3cyclictest0-21swapper/211:50:002
1471932993427,3cyclictest0-21swapper/211:50:002
1471932993426,5cyclictest1-21systemd08:45:022
1471931993426,5cyclictest1620516-21cron12:15:011
1471931993426,5cyclictest1614474-21munin-plugin-st12:05:011
1471931993426,5cyclictest1609328-21kernelversion11:56:031
1471931993425,6cyclictest1476453-21systemd-run07:25:011
1471931993424,6cyclictest1603860-21switchtime11:46:171
1471931993424,6cyclictest1603860-21switchtime11:46:171
1471930993427,4cyclictest1530013-21aten_r2power_po09:45:580
1471930993424,8cyclictest420-21avahi-daemon11:16:130
1471930993424,7cyclictest1542111-21basename10:05:570
1471930993421,10cyclictest0-21swapper/011:11:010
1471932993326,4cyclictest1631409-21grep12:31:192
1471932993326,4cyclictest1543235-21unixbench-2d10:06:182
1471932993325,5cyclictest1514027-21cron09:20:012
1471932993325,5cyclictest1480921-21sendmail07:40:012
1471932993325,4cyclictest1000-21mta-sts-daemon07:56:112
1471932993324,5cyclictest0-21swapper/207:31:112
1471932993323,7cyclictest1582882-21vmstat11:11:212
1471932993323,6cyclictest420-21avahi-daemon12:16:572
1471931993327,3cyclictest0-21swapper/109:10:011
1471931993326,5cyclictest1471929-21cyclictest11:01:091
1471931993326,4cyclictest1532399-21grep09:50:011
1471931993325,5cyclictest1521446-21ntp_kernel_pll_09:31:101
1471930993329,2cyclictest0-21swapper/011:00:010
1471930993328,3cyclictest1498904-21cron08:40:010
1471930993325,5cyclictest695189-21cups-browsed12:25:560
1471930993324,6cyclictest1546008-21mailstats10:11:160
1471932993226,4cyclictest1471929-21cyclictest09:25:512
1471932993226,3cyclictest0-21swapper/210:01:082
1471932993226,3cyclictest0-21swapper/207:15:012
1471932993225,3cyclictest0-21swapper/212:21:162
1471931993224,5cyclictest695189-21cups-browsed10:26:191
1471931993224,5cyclictest1581833-21cut11:11:001
1471931993224,5cyclictest1485349-21head07:51:181
1471931993224,5cyclictest1485349-21head07:51:181
1471931993224,3cyclictest0-21swapper/112:06:151
1471931993223,6cyclictest1489537-21systemctl08:06:151
1471931993220,9cyclictest1474914-21sendmail07:20:011
1471930993226,4cyclictest1609221-21/usr/sbin/munin11:56:020
1471930993225,4cyclictest1596198-21cron11:35:010
1471930993224,6cyclictest1-21systemd10:26:110
1471930993224,5cyclictest420-21avahi-daemon11:25:460
1471932993125,3cyclictest0-21swapper/208:15:012
1471932993124,4cyclictest1614629-21latency_hist12:05:022
1471932993123,5cyclictest420-21avahi-daemon11:17:092
1471932993123,5cyclictest1558417-21unixbench-2d10:31:192
1471932993122,6cyclictest420-21avahi-daemon11:27:592
1471932993122,6cyclictest1533134-21cpu09:51:002
1471932993121,7cyclictest1615963-21mailstats12:06:152
1471931993124,5cyclictest1003-21mta-sts-daemon10:51:141
1471931993124,4cyclictest1003-21mta-sts-daemon11:34:531
1471931993122,6cyclictest695189-21cups-browsed12:21:001
147193099314,11cyclictest1507926-21diskmemload11:50:530
147193099314,11cyclictest1507926-21diskmemload11:50:530
1471930993126,3cyclictest1562766-21munin-plugin-st10:40:010
1471930993126,3cyclictest1002-21mta-sts-daemon11:21:190
1471930993125,4cyclictest1557370-21aten_r2power_vo10:30:570
1471930993124,4cyclictest1534725-21kworker/u8:12-xprtiod10:21:040
1471930993124,4cyclictest1481472-21fschecks_time07:41:010
1471930993124,4cyclictest1471941-21systemd-run07:10:020
1471930993121,7cyclictest1620522-21latency_hist12:15:020
1471930993120,4cyclictest1485305-21unixbench_multi07:51:180
1471930993120,4cyclictest1485305-21unixbench_multi07:51:180
1471932993022,5cyclictest420-21avahi-daemon07:21:152
1471932993022,5cyclictest1474905-21cron07:20:012
1471932993021,7cyclictest1575017-21latency_hist11:00:022
1471932993020,7cyclictest1504262-21ntp_kernel_err08:56:082
1471932993019,8cyclictest1510540-21sh09:13:422
1471931993022,5cyclictest695189-21cups-browsed09:21:061
1471931993022,5cyclictest1621362-21fschecks_time12:16:041
1471931993022,5cyclictest1487467-21fschecks_time08:01:001
1471930993023,4cyclictest1613224-21tail12:01:200
147193299294,11cyclictest1507926-21diskmemload10:51:162
1471932992924,2cyclictest0-21swapper/211:56:112
1471932992923,4cyclictest1471929-21cyclictest12:26:032
1471932992921,5cyclictest1521138-21kernelversion09:31:032
1471932992920,6cyclictest1482447-21systemd-run07:45:012
1471931992922,4cyclictest1500428-21sh08:45:011
1471931992922,4cyclictest1001-21mta-sts-daemon10:08:031
1471931992922,4cyclictest0-21swapper/111:26:191
1471931992921,5cyclictest1627392-21/usr/sbin/munin12:26:001
147193199290,23cyclictest1533673-21ssh09:51:141
1471930992924,2cyclictest0-21swapper/012:35:010
1471930992923,4cyclictest1003-21mta-sts-daemon09:15:420
1471930992923,3cyclictest0-21swapper/009:41:100
1471930992922,4cyclictest1625391-21unixbench_singl12:21:200
1471930992922,4cyclictest1474957-21systemd-run07:20:010
1471930992922,4cyclictest1002-21mta-sts-daemon10:16:070
1471932992822,3cyclictest0-21swapper/209:41:062
1471932992820,5cyclictest695189-21cups-browsed08:15:282
1471932992819,7cyclictest1515508-21mailstats09:21:162
1471932992818,8cyclictest1565462-21sh10:43:552
1471931992821,4cyclictest1490446-21fschecks_count08:10:591
1471931992820,4cyclictest0-21swapper/110:46:071
1471930992822,4cyclictest1487002-21latency_hist08:00:010
1471930992822,3cyclictest0-21swapper/012:36:020
1471930992821,4cyclictest1599339-21latency_hist11:40:020
1471930992816,10cyclictest0-21swapper/009:26:020
1471930992813,10cyclictest1615863-21ps12:06:130
1471932992721,3cyclictest0-21swapper/210:36:132
1471932992721,3cyclictest0-21swapper/210:26:052
1471932992720,3cyclictest0-21swapper/208:31:182
1471932992719,5cyclictest428-21mta-sts-daemon07:25:182
1471932992718,6cyclictest1003-21mta-sts-daemon12:10:322
1471932992716,8cyclictest421-21dbus-daemon07:55:012
1471932992716,8cyclictest421-21dbus-daemon07:55:012
1471931992722,2cyclictest0-21swapper/111:51:071
1471931992722,2cyclictest0-21swapper/111:51:071
1471931992721,3cyclictest1463958-21kworker/u8:4-xprtiod07:15:011
1471931992721,3cyclictest0-21swapper/108:25:011
1471931992720,4cyclictest1495917-21cron08:30:011
1471931992719,5cyclictest695189-21cups-browsed10:44:491
1471931992719,5cyclictest1590151-21munin-run11:25:011
1471931992719,5cyclictest0-21swapper/111:16:041
1471931992718,5cyclictest1001-21mta-sts-daemon07:25:531
1471931992717,8cyclictest1546161-21timerandwakeup10:11:201
1471930992721,4cyclictest695189-21cups-browsed08:43:580
1471930992721,3cyclictest1503314-21unixbench_multi08:51:180
1471930992721,3cyclictest1495939-21systemd-run08:30:010
1471930992720,4cyclictest1480906-21cron07:40:010
1471930992718,6cyclictest421-21dbus-daemon10:04:370
1471930992718,3cyclictest1601041-21sed11:41:210
1471932992620,3cyclictest0-21swapper/211:06:092
1471932992618,5cyclictest1488736-21head08:05:572
1471932992618,5cyclictest1482961-21fschecks_time07:46:002
1471932992617,6cyclictest0-21swapper/208:50:592
1471931992620,3cyclictest1479402-21kworker/u8:0-xprtiod07:36:121
1471931992620,3cyclictest0-21swapper/110:31:001
1471931992619,4cyclictest1505393-21cpuspeed09:00:581
1471931992619,4cyclictest1496327-21aten_r2power_vo08:30:571
1471931992618,5cyclictest1498805-21unixbench_multi08:36:211
1471930992621,2cyclictest0-21swapper/008:56:080
1471930992620,4cyclictest1471929-21cyclictest07:21:080
1471930992620,3cyclictest0-21swapper/008:01:010
1471930992619,4cyclictest1490444-21grep08:10:590
1471930992617,2cyclictest0-21swapper/008:25:020
147193399258,13cyclictest0-21swapper/307:31:043
1471932992520,2cyclictest0-21swapper/211:31:002
1471932992520,2cyclictest0-21swapper/208:40:012
1471931992518,4cyclictest1000-21mta-sts-daemon12:39:081
1471931992516,6cyclictest1492857-21unixbench_singl08:16:181
1471931992515,7cyclictest265-21systemd-journal08:55:011
1471930992519,4cyclictest421-21dbus-daemon08:10:020
1471930992518,4cyclictest1496453-21fschecks_time08:30:590
147193399246,14cyclictest0-21swapper/311:44:283
1471932992416,4cyclictest0-21swapper/210:10:072
1471932992415,6cyclictest1501761-21unixbench-2d08:46:222
1471930992420,2cyclictest0-21swapper/009:05:020
1471930992419,2cyclictest0-21swapper/007:15:010
1471930992412,9cyclictest1507343-21ntpq09:06:090
147193399236,13cyclictest0-21swapper/309:47:523
147193399236,13cyclictest0-21swapper/309:31:093
147193399236,12cyclictest0-21swapper/311:51:053
147193399236,12cyclictest0-21swapper/311:51:053
147193399235,14cyclictest0-21swapper/311:45:333
147193399235,14cyclictest0-21swapper/311:45:333
1471932992318,2cyclictest0-21swapper/208:01:072
147193399228,10cyclictest0-21swapper/310:46:163
147193399227,10cyclictest0-21swapper/312:06:103
147193399227,10cyclictest0-21swapper/311:36:133
147193399226,13cyclictest0-21swapper/309:19:043
147193399226,12cyclictest0-21swapper/310:10:403
147193399225,13cyclictest0-21swapper/311:26:153
1471931992216,3cyclictest0-21swapper/107:10:011
147193399216,11cyclictest0-21swapper/311:21:113
147193399216,11cyclictest0-21swapper/310:21:133
147193399216,10cyclictest0-21swapper/309:15:003
147193399216,10cyclictest0-21swapper/308:16:073
147193399215,12cyclictest0-21swapper/312:11:593
147193399215,12cyclictest0-21swapper/311:17:463
147193399207,9cyclictest0-21swapper/311:11:003
147193399206,11cyclictest0-21swapper/310:06:133
147193399206,10cyclictest0-21swapper/311:07:243
147193399206,10cyclictest0-21swapper/310:51:083
147193399206,10cyclictest0-21swapper/310:41:113
147193399206,10cyclictest0-21swapper/310:16:103
147193399206,10cyclictest0-21swapper/309:26:023
147193399205,12cyclictest0-21swapper/312:17:163
147193399205,12cyclictest0-21swapper/310:30:013
147193399205,11cyclictest0-21swapper/312:21:503
147193399205,11cyclictest0-21swapper/311:58:333
147193399205,11cyclictest0-21swapper/310:01:033
147193399205,11cyclictest0-21swapper/309:51:523
147193399205,11cyclictest0-21swapper/309:43:523
147193399205,11cyclictest0-21swapper/309:20:303
147193399204,12cyclictest0-21swapper/311:01:503
1471932992013,5cyclictest439-21systemd-logind07:10:012
147193399199,5cyclictest0-21swapper/307:56:103
147193399199,5cyclictest0-21swapper/307:51:123
147193399199,5cyclictest0-21swapper/307:51:123
147193399195,10cyclictest0-21swapper/311:33:003
147193399195,10cyclictest0-21swapper/310:35:133
147193399195,10cyclictest0-21swapper/310:30:183
147193399194,11cyclictest0-21swapper/312:01:303
147193399194,11cyclictest0-21swapper/310:58:413
147193399191,15cyclictest0-21swapper/312:26:353
147193399188,5cyclictest0-21swapper/307:36:103
147193399186,9cyclictest0-21swapper/309:06:023
147193399185,9cyclictest0-21swapper/312:35:363
147193399184,10cyclictest0-21swapper/309:37:193
147193399178,6cyclictest0-21swapper/307:11:073
147193399178,5cyclictest0-21swapper/307:16:123
147193399178,4cyclictest0-21swapper/307:46:083
147193399176,8cyclictest0-21swapper/308:55:013
147193399176,8cyclictest0-21swapper/308:11:083
147193399176,8cyclictest0-21swapper/308:01:033
147193399176,7cyclictest0-21swapper/309:55:033
147193399176,7cyclictest0-21swapper/307:26:073
147193399175,9cyclictest0-21swapper/312:30:583
147193399170,13cyclictest0-21swapper/308:25:573
147193399168,5cyclictest0-21swapper/308:56:083
147193399168,5cyclictest0-21swapper/308:31:083
147193399167,5cyclictest0-21swapper/308:41:103
147193399167,5cyclictest0-21swapper/307:21:093
147193399165,8cyclictest0-21swapper/308:45:483
147193399160,12cyclictest0-21swapper/307:43:403
147193399159,4cyclictest0-21swapper/308:21:053
147193399159,4cyclictest0-21swapper/308:06:123
147193399158,5cyclictest0-21swapper/307:10:013
147193399158,4cyclictest0-21swapper/308:36:103
147193399150,12cyclictest0-21swapper/309:04:233
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional