You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-27 - 05:16
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot6.osadl.org (updated Mon Jul 27, 2026 00:44:53)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
187986899129123,4cyclictest1967034-21kworker/u8:3+events_unbound23:40:261
187986699128120,5cyclictest1956683-21latency_hist23:10:010
187986899125117,6cyclictest1875285-21kworker/u8:2+events_unbound19:10:251
187986899121108,10cyclictest1958282-21apt-get23:15:011
187986899120109,8cyclictest1912914-21kworker/u8:1+flush-179:020:50:251
187986899119110,5cyclictest1890907-21kworker/u8:0+events_unbound19:55:001
187986899119109,7cyclictest1974516-21latency_hist00:05:001
187986899116108,5cyclictest1940816-21kworker/u8:2+flush-179:022:40:251
187986699115106,3cyclictest1927755-21kworker/u8:1+events_unbound22:00:190
187986699115104,4cyclictest1902027-21kworker/u8:0+events_unbound20:55:240
187986899114105,6cyclictest1897335-21kworker/u8:1+events_unbound20:15:001
187986699114105,6cyclictest1950323-21latency_hist22:50:010
187986899112103,7cyclictest1927755-21kworker/u8:1+flush-179:022:20:001
187986899111105,4cyclictest1907122-21kworker/u8:2+flush-179:021:05:261
187986699110105,3cyclictest1902027-21kworker/u8:0+events_unbound21:30:190
187986699110100,7cyclictest1958269-21latency_hist23:15:010
18798689910996,9cyclictest1213033-21systemd-journal20:30:001
187986899109101,6cyclictest1902027-21kworker/u8:0+events_unbound21:00:011
187986899108103,3cyclictest1881342-21kworker/u8:1+flush-179:019:20:011
18798669910898,8cyclictest1984574-21apt-get00:35:110
187986699108103,4cyclictest1894331-21kworker/u8:2+events_unbound19:55:240
18798689910594,9cyclictest1931218-21apt-get21:50:101
18798669910591,11cyclictest1972880-40mandb00:00:010
18798689910494,6cyclictest1881405-21kworker/u8:3+events_unbound19:25:211
18798669910497,5cyclictest1971296-21kworker/u8:1+flush-179:000:30:010
18798689910397,4cyclictest1924641-21kworker/u8:2+events_unbound21:35:191
18798689910396,5cyclictest1894331-21kworker/u8:2+events_unbound20:00:011
18798689910192,6cyclictest1887712-21kworker/u8:1+flush-179:019:40:251
18798689910179,12cyclictest1894331-21kworker/u8:2+flush-179:020:05:241
18798689910095,3cyclictest1966464-21kworker/u8:2+flush-179:023:45:211
18798669910095,4cyclictest1902027-21kworker/u8:0+events_unbound20:40:290
18798669910088,10cyclictest1979801-21/usr/sbin/munin00:20:240
1879868999890,6cyclictest1887730-21latency_hist19:35:011
1879868999689,4cyclictest1935158-21kworker/u8:2+events_unbound22:05:181
1879866999685,8cyclictest1213033-21systemd-journal20:20:020
1879868999587,5cyclictest1974505-21kworker/u8:0+events_unbound00:10:001
1879868999584,7cyclictest1913485-21kworker/u8:3+flush-179:021:00:181
1879868999281,7cyclictest1902027-21kworker/u8:0+flush-179:021:40:161
1879868999185,4cyclictest1881405-21kworker/u8:3+flush-179:019:20:211
1879868999185,4cyclictest1881405-21kworker/u8:3+flush-179:019:20:201
1879866999187,3cyclictest1940816-21kworker/u8:2+events_unbound22:35:000
1879866999180,8cyclictest1953767-21apt-get23:00:120
1879868999085,3cyclictest1902027-21kworker/u8:0+events_unbound21:15:261
1879868999081,7cyclictest1974505-21kworker/u8:0+events_unbound00:20:011
1879866999078,9cyclictest1213033-21systemd-journal21:40:000
1879868998983,4cyclictest1974505-21kworker/u8:0+flush-179:000:30:231
1879868998979,8cyclictest1963567-21apt-get23:30:121
1879866998976,10cyclictest1902062-21apt-get20:19:590
1879868998882,4cyclictest1974505-21kworker/u8:0+flush-179:000:10:191
1879868998881,5cyclictest1897335-21kworker/u8:1+flush-179:020:30:191
1879868998879,3cyclictest1902027-21kworker/u8:0+events_unbound22:20:241
1879866998783,3cyclictest1902027-21kworker/u8:0+events_unbound22:15:230
1879868998680,4cyclictest1972310-21journal-offline23:55:221
1879868998679,5cyclictest1957674-21kworker/u8:0+flush-179:023:15:251
1879868998679,4cyclictest1971296-21kworker/u8:1+events_unbound00:25:191
1879866998682,3cyclictest1907122-21kworker/u8:2+events_unbound20:35:240
1879866998681,4cyclictest1907122-21kworker/u8:2+events_unbound21:05:210
1879866998674,9cyclictest510-21rs:main0
1879868998577,7cyclictest1902027-21kworker/u8:0+events_unbound21:15:001
1879868998577,6cyclictest1902027-21kworker/u8:0+flush-179:022:10:171
1879868998577,6cyclictest1902027-21kworker/u8:0+flush-179:022:10:161
1879868998474,6cyclictest1900439-21kworker/u8:2+flush-179:020:15:161
1879866998475,6cyclictest1960145-21latency_hist23:20:020
1879868998377,4cyclictest1950354-21kworker/u8:3+flush-179:023:20:161
1879866998378,3cyclictest1960091-21kworker/u8:1+events_unbound23:36:260
1879868998274,6cyclictest1974505-21kworker/u8:0+events_unbound00:25:011
1879868998267,13cyclictest1902027-21kworker/u8:0+flush-179:022:35:011
1879873998174,5cyclictest1908680-21turbostat20:40:003
1879866998173,5cyclictest1947131-21latency_hist22:40:000
1879866998172,7cyclictest1934156-21latency_hist22:00:010
1879868998074,4cyclictest1967034-21kworker/u8:3+flush-179:023:50:161
1879868998074,4cyclictest1902027-21kworker/u8:0+events_unbound20:40:231
1879868998073,5cyclictest1940816-21kworker/u8:2+flush-179:022:35:241
1879868998072,5cyclictest1902027-21kworker/u8:0+flush-179:022:25:241
1879866998076,3cyclictest1902027-21kworker/u8:0+events_unbound22:24:560
1879866998071,7cyclictest1952141-21/usr/sbin/munin22:55:170
1879868997973,4cyclictest1902027-21kworker/u8:0+flush-179:022:00:011
1879868997972,5cyclictest1950311-21kworker/u8:1+events_unbound22:50:221
1879868997972,4cyclictest1890907-21kworker/u8:0+flush-179:019:45:251
1879866997975,3cyclictest1967034-21kworker/u8:3+events_unbound23:52:340
1879866997974,4cyclictest1902027-21kworker/u8:0+events_unbound21:02:260
1879866997974,4cyclictest1881405-21kworker/u8:3+events_unbound19:42:260
1879866997973,4cyclictest1881616-21apt-get19:15:130
1879866997972,5cyclictest1902027-21kworker/u8:0+flush-179:021:50:000
1879868997872,4cyclictest1927755-21kworker/u8:1+flush-179:021:45:261
1879868997867,8cyclictest1927755-21kworker/u8:1+flush-179:022:00:201
1879866997874,3cyclictest1960091-21kworker/u8:1+events_unbound23:29:260
1879868997771,3cyclictest1894332-21kworker/u8:3+flush-179:020:00:211
1879868997769,5cyclictest1902027-21kworker/u8:0+flush-179:021:30:251
1879868997768,5cyclictest1902027-21kworker/u8:0+flush-179:020:20:201
1879866997772,4cyclictest1927755-21kworker/u8:1+events_unbound22:13:270
1879866997772,4cyclictest1927755-21kworker/u8:1+events_unbound22:13:260
1879866997671,4cyclictest1974505-21kworker/u8:0+events_unbound00:15:120
1879866997671,4cyclictest1881405-21kworker/u8:3+events_unbound19:29:250
1879866997571,3cyclictest1971296-21kworker/u8:1+events_unbound00:08:240
1879866997571,3cyclictest1907122-21kworker/u8:2+events_unbound21:11:010
1879866997470,3cyclictest1887712-21kworker/u8:1+events_unbound19:37:260
1879866997469,4cyclictest1927755-21kworker/u8:1+events_unbound22:09:260
1879868997366,5cyclictest1960091-21kworker/u8:1+flush-179:023:25:211
1879866997369,3cyclictest1890907-21kworker/u8:0+events_unbound20:09:560
1879866997368,3cyclictest1894332-21kworker/u8:3+events_unbound20:00:210
1879868997263,6cyclictest1985910-21latency_hist00:40:011
1879866997268,3cyclictest1960091-21kworker/u8:1+events_unbound23:24:260
1879866997166,4cyclictest1903949-21kworker/u8:3+events_unbound20:34:250
1879866997162,4cyclictest1907122-21kworker/u8:2+events_unbound20:50:190
1879868997065,4cyclictest1907122-21kworker/u8:2+flush-179:020:35:281
1879868997065,3cyclictest1902027-21kworker/u8:0+flush-179:022:45:181
1879866997064,4cyclictest1982989-21apt-get00:30:120
1879866997064,4cyclictest1968091-21latency_hist23:45:010
1879866997056,10cyclictest1890907-21kworker/u8:0+flush-179:019:45:220
1879866996965,3cyclictest1920052-21kworker/u8:1+events_unbound21:21:010
1879866996965,3cyclictest1902027-21kworker/u8:0+events_unbound22:52:250
1879868996862,4cyclictest1887712-21kworker/u8:1+flush-179:019:35:201
1879866996863,4cyclictest1881342-21kworker/u8:1+flush-179:019:12:250
1879868996760,5cyclictest1950311-21kworker/u8:1+events_unbound23:00:191
1879868996657,6cyclictest1950311-21kworker/u8:1+flush-179:023:10:001
1879866996661,4cyclictest1960091-21kworker/u8:1+events_unbound23:34:270
1879866996561,3cyclictest1971296-21kworker/u8:1+events_unbound00:12:250
1879868996458,3cyclictest1920052-21kworker/u8:1+events_unbound21:20:181
1879866996460,3cyclictest1971296-21kworker/u8:1+events_unbound00:01:260
1879868996357,4cyclictest1902027-21kworker/u8:0+flush-179:020:45:211
1879868996356,5cyclictest1961709-21kworker/u8:0+flush-179:023:35:191
1879866996357,4cyclictest1927755-21kworker/u8:1+events_unbound21:50:030
1879868996253,7cyclictest1950311-21kworker/u8:1+flush-179:022:55:211
1879866996251,8cyclictest510-21rs:main0
1879868995953,4cyclictest1920052-21kworker/u8:1+flush-179:021:25:151
1879866995853,4cyclictest1900439-21kworker/u8:2+events_unbound20:13:270
1879866995753,3cyclictest1902027-21kworker/u8:0+events_unbound21:15:020
1879866995752,4cyclictest1966464-21kworker/u8:2+events_unbound23:45:240
1879866995652,3cyclictest1887712-21kworker/u8:1+events_unbound19:51:270
1879866995650,5cyclictest1902027-21kworker/u8:0+flush-179:022:25:260
1879866995551,3cyclictest1927755-21kworker/u8:1+events_unbound21:41:080
1879866995349,3cyclictest1902027-21kworker/u8:0+events_unbound20:45:540
1879866995348,4cyclictest1902027-21kworker/u8:0+events_unbound22:42:260
1879873995249,2cyclictest0-21swapper/322:41:593
4577091500,13ptp4l441ktimers/319:10:013
4577091500,13ptp4l441ktimers/319:10:013
1879871995047,2cyclictest0-21swapper/220:47:592
1879866994944,4cyclictest1897335-21kworker/u8:1+events_unbound20:28:570
187987199440,35cyclictest0-21swapper/219:39:002
1879866994439,4cyclictest1883208-21kworker/u8:0+events_unbound19:23:260
1879866994439,4cyclictest1883208-21kworker/u8:0+events_unbound19:23:260
4577091430,6ptp4l431rcuc/319:50:003
1879871994138,2cyclictest0-21swapper/221:33:592
187987199400,2cyclictest0-21swapper/222:26:592
187987399390,38cyclictest1923016-21turbostat21:25:003
187987399380,37cyclictest0-21swapper/321:13:003
187987199380,36cyclictest0-21swapper/220:52:592
187987199380,35cyclictest0-21swapper/223:31:592
1879871993734,2cyclictest0-21swapper/220:44:552
1879873993634,1cyclictest0-21swapper/321:32:583
1879873993634,1cyclictest0-21swapper/320:02:593
1879873993633,2cyclictest0-21swapper/300:35:003
187987399360,35cyclictest0-21swapper/323:34:593
187987399360,35cyclictest0-21swapper/322:59:593
187987399360,35cyclictest0-21swapper/322:09:553
187987399360,35cyclictest0-21swapper/321:19:583
187987399360,35cyclictest0-21swapper/319:59:543
187987399360,1cyclictest0-21swapper/323:06:593
1879871993634,1cyclictest0-21swapper/221:49:582
1879871993634,1cyclictest0-21swapper/221:15:002
1879871993633,2cyclictest0-21swapper/200:03:592
187987199360,2cyclictest0-21swapper/200:17:592
1879873993533,1cyclictest0-21swapper/323:58:593
187987399350,34cyclictest0-21swapper/321:00:593
1879871993532,2cyclictest0-21swapper/220:29:562
1879871993532,2cyclictest0-21swapper/220:13:002
187987199350,1cyclictest0-21swapper/220:19:592
1879873993432,1cyclictest0-21swapper/322:15:003
1879873993432,1cyclictest0-21swapper/322:14:593
1879873993331,1cyclictest0-21swapper/320:53:593
1879873993331,1cyclictest0-21swapper/320:17:583
1879873993331,1cyclictest0-21swapper/320:14:583
1879873993331,1cyclictest0-21swapper/319:14:593
1879871993330,2cyclictest0-21swapper/221:40:592
1879871993329,2cyclictest0-21swapper/222:59:552
1879873993230,1cyclictest0-21swapper/323:19:593
1879873993230,1cyclictest0-21swapper/322:38:593
1879871993229,2cyclictest0-21swapper/220:33:592
1879871993229,2cyclictest0-21swapper/200:14:592
1879866993221,2cyclictest171rcu_preempt19:10:020
1879866993221,2cyclictest171rcu_preempt19:10:020
4577091310,7ptp4l441ktimers/322:25:003
1879873993129,1cyclictest0-21swapper/323:20:583
1879871993129,1cyclictest0-21swapper/222:54:592
1879871993128,2cyclictest0-21swapper/220:04:552
4577091300,7ptp4l441ktimers/322:00:003
4577091300,7ptp4l441ktimers/321:09:593
1879873993028,1cyclictest0-21swapper/321:44:553
1879873993027,2cyclictest0-21swapper/321:54:593
187987399300,2cyclictest0-21swapper/321:25:143
1879871993027,2cyclictest0-21swapper/223:56:592
1879871993027,2cyclictest0-21swapper/220:07:592
187987199300,2cyclictest0-21swapper/220:20:012
187987199300,28cyclictest0-21swapper/200:20:142
4577091290,7ptp4l61490irq/134-eno1-TxRx-020:50:003
4577091290,6ptp4l61490irq/134-eno1-TxRx-020:30:013
4577091290,6ptp4l441ktimers/322:34:563
4577091290,6ptp4l441ktimers/300:15:013
4577091290,5ptp4l441ktimers/319:25:013
1879873992927,1cyclictest0-21swapper/323:12:593
1879873992927,1cyclictest0-21swapper/322:29:003
1879873992927,1cyclictest0-21swapper/321:36:593
1879873992926,2cyclictest0-21swapper/319:52:593
187987399290,28cyclictest0-21swapper/320:05:153
187987399290,28cyclictest0-21swapper/300:00:153
187987399290,1cyclictest0-21swapper/319:40:133
187987399290,1cyclictest0-21swapper/319:15:153
1879871992926,2cyclictest0-21swapper/223:25:142
187987199290,2cyclictest0-21swapper/220:56:592
187987199290,27cyclictest0-21swapper/223:50:122
187987199290,27cyclictest0-21swapper/223:40:142
187987199290,27cyclictest0-21swapper/223:05:162
187987199290,27cyclictest0-21swapper/222:05:042
187987199290,27cyclictest0-21swapper/222:00:132
187987199290,27cyclictest0-21swapper/221:25:142
187987199290,27cyclictest0-21swapper/219:55:132
187987199290,27cyclictest0-21swapper/219:50:132
187987199290,27cyclictest0-21swapper/219:40:142
187987199290,27cyclictest0-21swapper/219:30:122
187987199290,27cyclictest0-21swapper/219:20:122
187987199290,27cyclictest0-21swapper/219:20:122
187987199290,27cyclictest0-21swapper/219:15:152
4577091280,7ptp4l61490irq/134-eno1-TxRx-000:25:013
4577091280,6ptp4l61490irq/134-eno1-TxRx-023:50:003
4577091280,6ptp4l61490irq/134-eno1-TxRx-020:35:003
4577091280,6ptp4l441ktimers/300:29:563
4577091280,5ptp4l441ktimers/323:44:563
4577091280,5ptp4l441ktimers/322:50:003
4577091280,5ptp4l441ktimers/300:20:013
4577091280,4ptp4l441ktimers/321:50:023
1879873992826,1cyclictest0-21swapper/323:37:593
1879873992826,1cyclictest0-21swapper/323:00:143
187987399280,21cyclictest0-21swapper/300:35:133
187987199280,2cyclictest0-21swapper/222:30:142
187987199280,2cyclictest0-21swapper/222:15:142
187987199280,26cyclictest0-21swapper/223:15:022
187987199280,26cyclictest0-21swapper/222:40:142
187987199280,26cyclictest0-21swapper/221:35:162
187987199280,26cyclictest0-21swapper/221:20:152
4577091270,7ptp4l61490irq/134-eno1-TxRx-019:35:003
4577091270,5ptp4l441ktimers/322:54:553
4577091270,5ptp4l441ktimers/319:39:563
4577091270,5ptp4l441ktimers/300:09:553
4577091270,4ptp4l441ktimers/321:00:013
1879873992725,1cyclictest0-21swapper/322:15:133
1879873992724,2cyclictest0-21swapper/320:20:133
187987399270,27cyclictest0-21swapper/319:20:123
187987399270,27cyclictest0-21swapper/319:20:123
187987199270,2cyclictest0-21swapper/223:22:592
187987199270,25cyclictest0-21swapper/222:23:592
4577091260,5ptp4l61490irq/134-eno1-TxRx-020:45:013
4577091260,4ptp4l441ktimers/323:29:553
4577091260,4ptp4l441ktimers/322:04:563
1879873992623,2cyclictest0-21swapper/323:52:593
1879871992623,2cyclictest0-21swapper/220:35:142
1879871992623,2cyclictest0-21swapper/200:26:592
187987199260,2cyclictest0-21swapper/223:47:592
187987199260,24cyclictest0-21swapper/223:02:592
187987199260,1cyclictest0-21swapper/219:45:132
1879871992523,1cyclictest0-21swapper/222:10:132
1879871992523,1cyclictest0-21swapper/222:10:132
1879871992522,2cyclictest0-21swapper/223:36:002
1879871992321,1cyclictest0-21swapper/219:12:002
1879871992320,2cyclictest0-21swapper/222:45:132
1879871992320,2cyclictest0-21swapper/221:09:592
1879871992320,2cyclictest0-21swapper/219:27:592
1879871992220,1cyclictest0-21swapper/200:39:592
1879871992219,2cyclictest0-21swapper/223:11:592
1879871992219,2cyclictest0-21swapper/221:18:592
1879868992213,7cyclictest1879747-21latency_hist19:10:021
1879868992213,7cyclictest1879747-21latency_hist19:10:021
1879871992119,1cyclictest0-21swapper/221:59:592
1879871991916,2cyclictest0-21swapper/221:50:592
1879871991613,2cyclictest0-21swapper/222:38:592
1879871991512,2cyclictest0-21swapper/200:35:002
1879871991310,2cyclictest0-21swapper/221:01:002
18798719974,2cyclictest0-21swapper/200:08:042
18798719930,2cyclictest0-21swapper/219:10:012
18798719930,2cyclictest0-21swapper/219:10:002
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional