You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-15 - 15:51
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot6.osadl.org (updated Mon Dec 15, 2025 12:44:53)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
95846998169,10cyclictest182271-21apt-get11:40:000
95846997772,3cyclictest131106-21kworker/u8:0+events_unbound09:15:000
95846997665,8cyclictest100765-21/usr/sbin/munin07:25:240
95846997665,8cyclictest100765-21/usr/sbin/munin07:25:240
95848996960,6cyclictest126518-21/usr/sbin/munin08:45:241
95848996857,8cyclictest120148-21/usr/sbin/munin08:25:231
95846996862,4cyclictest198689-21latency_hist12:30:020
95848996660,4cyclictest142182-21kworker/u8:1+events_unbound10:20:231
95848996660,4cyclictest107156-21kworker/u8:1+flush-179:008:05:271
95848996658,5cyclictest197101-21latency_hist12:25:011
95846996559,4cyclictest95693-21kworker/u8:2+flush-179:007:15:010
95846996558,5cyclictest174251-21kworker/u8:0+flush-179:011:40:170
95848996458,4cyclictest121735-21kworker/u8:2+events_unbound08:35:241
95846996356,5cyclictest142182-21kworker/u8:1+events_unbound10:30:000
95848996256,4cyclictest131106-21kworker/u8:0+flush-179:009:15:211
95846995951,6cyclictest200277-21latency_hist12:35:000
95846995951,6cyclictest200277-21latency_hist12:35:000
95848995851,5cyclictest266-21systemd-journal08:40:271
95848995848,7cyclictest121735-21kworker/u8:2+flush-179:008:30:151
95848995750,5cyclictest174251-21kworker/u8:0+flush-179:011:15:171
95848995651,4cyclictest95693-21kworker/u8:2+flush-179:007:10:211
95846995652,3cyclictest103992-21kworker/u8:0+flush-179:007:40:250
95848995548,5cyclictest110329-21kworker/u8:2+flush-179:007:55:261
95846995546,7cyclictest99195-21apt-get07:20:110
95848995446,5cyclictest148846-21kworker/u8:2+flush-179:010:15:221
95848995348,4cyclictest174251-21kworker/u8:0+events_unbound11:55:001
95848995347,4cyclictest192559-21/usr/sbin/munin12:10:231
95848995249,2cyclictest95693-21kworker/u8:2+events_unbound07:30:251
95846995241,9cyclictest186191-21/usr/sbin/munin11:50:230
95848995146,4cyclictest158611-21kworker/u8:0+events_unbound11:00:001
95846995146,3cyclictest166297-21kworker/u8:3+flush-179:010:55:280
95846995141,8cyclictest121754-21apt-get08:30:120
95848995043,5cyclictest510-21rs:main1
95848995043,5cyclictest266-21systemd-journal09:49:071
95848994939,8cyclictest266-21systemd-journal08:55:001
95846994945,3cyclictest174251-21kworker/u8:0+flush-179:011:25:220
95846994943,5cyclictest180637-21kworker/u8:1+flush-179:012:15:000
95846994939,7cyclictest137666-21/usr/sbin/munin09:20:230
4577091490,14ptp4l441ktimers/307:10:013
95846994844,3cyclictest148846-21kworker/u8:2+events_unbound10:10:150
95846994841,4cyclictest163191-21kworker/u8:2+flush-179:010:40:220
95853994739,5cyclictest156800-21turbostat10:20:013
95848994738,6cyclictest190735-21latency_hist12:05:021
95846994743,3cyclictest105574-21munin-run07:40:000
95846994738,6cyclictest115127-21latency_hist08:10:010
95851994644,1cyclictest0-21swapper/212:04:592
95846994641,4cyclictest111990-21kworker/u8:3+flush-179:008:20:220
95846994641,4cyclictest111990-21kworker/u8:3+flush-179:008:20:210
95846994640,4cyclictest140598-21latency_hist09:30:010
95846994638,6cyclictest201890-21latency_hist12:40:010
95846994637,7cyclictest147226-21latency_hist09:50:010
95848994538,6cyclictest190972-21kworker/u8:0+events_unbound12:25:151
95848994538,5cyclictest110329-21kworker/u8:2+flush-179:008:00:181
95848994536,7cyclictest194163-21apt-get12:15:131
95846994538,6cyclictest142182-21kworker/u8:1+flush-179:010:20:010
95848994437,6cyclictest103992-21kworker/u8:0+flush-179:007:45:001
95848994437,5cyclictest148846-21kworker/u8:2+flush-179:010:00:011
95848994437,5cyclictest148846-21kworker/u8:2+flush-179:010:00:001
95848994436,6cyclictest266-21systemd-journal08:15:231
95848994434,8cyclictest104243-21apt-get07:35:131
95848994338,4cyclictest158611-21kworker/u8:0+events_unbound10:25:241
95848994338,4cyclictest128099-21kworker/u8:3+flush-179:009:05:221
95848994338,4cyclictest128099-21kworker/u8:3+events_unbound08:55:251
9584899430,41cyclictest714-21Xorg11:45:591
95846994337,5cyclictest174251-21kworker/u8:0+flush-179:011:45:140
9584699431,37cyclictest714-21Xorg09:41:590
95846994237,4cyclictest166297-21kworker/u8:3+events_unbound11:30:240
95846994237,3cyclictest195554-21systemd-run12:20:000
9585399410,1cyclictest0-21swapper/310:13:003
95848994133,6cyclictest266-21systemd-journal12:40:001
95846994136,4cyclictest166297-21kworker/u8:3+events_unbound11:20:000
95846994136,4cyclictest121735-21kworker/u8:2+flush-179:008:35:220
95846994135,4cyclictest0-21swapper/008:17:590
9584699411,38cyclictest714-21Xorg09:58:000
9584699411,38cyclictest714-21Xorg09:58:000
95851994037,2cyclictest0-21swapper/212:37:592
95848994035,4cyclictest142182-21kworker/u8:1+events_unbound09:40:151
95848994035,2cyclictest714-21Xorg11:21:591
95848994034,5cyclictest135852-21kworker/u8:2+flush-179:009:20:221
95848994029,7cyclictest159995-21kworker/u8:3+flush-179:010:35:201
95846994036,3cyclictest159995-21kworker/u8:3+flush-179:010:35:250
95846994036,3cyclictest111993-21systemd-run08:00:000
95846994035,4cyclictest135852-21kworker/u8:2+events_unbound09:40:010
95846994034,5cyclictest128099-21kworker/u8:3+flush-179:008:55:230
95846994034,4cyclictest0-21swapper/009:54:580
95848993933,4cyclictest1-21systemd11:40:011
95848993932,5cyclictest148846-21kworker/u8:2+flush-179:010:15:011
95846993935,3cyclictest714-21Xorg10:20:580
9584699392,5cyclictest136074-21apt-get09:15:130
95851993835,2cyclictest0-21swapper/212:20:592
9585199380,35cyclictest0-21swapper/208:54:562
95848993833,3cyclictest95693-21kworker/u8:2+flush-179:007:30:001
95848993833,3cyclictest95693-21kworker/u8:2+flush-179:007:30:001
95848993833,3cyclictest714-21Xorg09:05:001
95848993833,3cyclictest108777-21apt07:50:001
95846993835,2cyclictest171135-21kworker/u8:1+events_unbound11:05:150
95846993833,4cyclictest103992-21kworker/u8:0+flush-179:007:50:240
9584699382,33cyclictest165000-21apt-get10:45:140
9584699381,7cyclictest0-21swapper/008:45:150
9584699381,34cyclictest129483-21true08:55:000
95851993734,2cyclictest0-21swapper/211:37:002
95851993734,2cyclictest0-21swapper/210:18:582
95851993734,2cyclictest0-21swapper/209:28:592
95851993734,2cyclictest0-21swapper/209:06:592
9585199370,35cyclictest0-21swapper/211:56:002
9585199370,35cyclictest0-21swapper/210:13:592
9584899372,31cyclictest134488-21apt-get09:10:131
9584899371,4cyclictest0-21swapper/110:45:151
95846993734,2cyclictest0-21swapper/011:21:580
95846993733,3cyclictest195550-21kworker/u8:2+flush-179:012:24:550
95846993733,3cyclictest121735-21kworker/u8:2+flush-179:008:45:010
95846993730,5cyclictest174281-21latency_hist11:15:020
95846993730,4cyclictest103992-21kworker/u8:0+flush-179:007:45:150
95846993727,8cyclictest152553-21diskstats10:05:150
9584699372,6cyclictest150676-21apt-get10:00:140
95853993634,1cyclictest0-21swapper/307:31:593
95853993633,2cyclictest0-21swapper/308:00:593
9585399360,35cyclictest0-21swapper/310:23:583
9585399360,35cyclictest0-21swapper/308:57:583
9585399360,35cyclictest0-21swapper/308:43:593
9585399360,35cyclictest0-21swapper/307:53:593
9585399360,2cyclictest0-21swapper/309:08:593
95851993633,2cyclictest0-21swapper/211:09:592
95851993633,2cyclictest0-21swapper/211:03:592
95851993633,2cyclictest0-21swapper/209:48:002
9585199360,1cyclictest0-21swapper/208:09:592
95848993632,3cyclictest281ktimers/112:30:141
95848993632,3cyclictest281ktimers/112:30:141
95848993631,4cyclictest167998-21latency_hist10:55:001
95848993629,6cyclictest158611-21kworker/u8:0+events_unbound10:30:271
95848993629,5cyclictest174251-21kworker/u8:0+flush-179:011:40:221
95848993628,6cyclictest166297-21kworker/u8:3+flush-179:011:10:121
95848993628,6cyclictest142182-21kworker/u8:1+flush-179:009:50:201
95848993626,7cyclictest177737-21apt-get11:25:121
95846993632,3cyclictest160658-21hwlatdetect10:30:180
95853993533,1cyclictest0-21swapper/311:22:593
9585399350,1cyclictest0-21swapper/311:37:593
95851993533,1cyclictest0-21swapper/211:34:582
95851993533,1cyclictest0-21swapper/210:49:582
95851993533,1cyclictest0-21swapper/209:59:592
95851993533,1cyclictest0-21swapper/209:59:592
95851993532,2cyclictest0-21swapper/210:28:002
95851993532,2cyclictest0-21swapper/208:23:592
95851993532,2cyclictest0-21swapper/208:23:592
9585199350,33cyclictest0-21swapper/208:45:592
9585199350,1cyclictest0-21swapper/212:27:592
95848993531,3cyclictest140602-21munin-plugin-st09:30:001
95848993528,4cyclictest0-21swapper/111:59:591
95848993527,6cyclictest110347-21latency_hist07:55:011
95848993526,6cyclictest95693-21kworker/u8:2+events_unbound07:20:181
9584899351,29cyclictest0-21swapper/110:05:141
95846993532,2cyclictest0-21swapper/009:05:000
95846993530,4cyclictest110329-21kworker/u8:2+flush-179:008:10:160
95846993529,5cyclictest166297-21kworker/u8:3+events_unbound10:50:240
95846993529,5cyclictest110329-21kworker/u8:2+flush-179:008:00:250
95853993431,2cyclictest0-21swapper/309:27:593
95853993428,5cyclictest171123-21turbostat11:05:003
95851993431,2cyclictest0-21swapper/212:13:592
95851993431,2cyclictest0-21swapper/208:34:552
95851993431,2cyclictest0-21swapper/208:28:592
95851993431,2cyclictest0-21swapper/207:54:552
95848993429,4cyclictest166297-21kworker/u8:3+flush-179:011:00:221
95848993429,3cyclictest131106-21kworker/u8:0+events_unbound09:30:141
9584899341,5cyclictest163416-21http10:40:141
95853993330,2cyclictest0-21swapper/310:28:593
95851993329,2cyclictest0-21swapper/208:14:552
95848993325,6cyclictest110329-21kworker/u8:2+flush-179:008:10:201
95848993318,13cyclictest0-21swapper/111:30:521
9584899331,3cyclictest0-21swapper/110:00:131
95846993327,5cyclictest102010-21kworker/u8:3+flush-179:007:30:040
95846993327,4cyclictest131106-21kworker/u8:0+flush-179:009:10:010
95846993326,5cyclictest0-21swapper/007:19:590
4577091330,4ptp4l441ktimers/308:55:013
95853993230,1cyclictest0-21swapper/312:00:593
95853993230,1cyclictest0-21swapper/308:13:593
95853993229,2cyclictest0-21swapper/310:40:593
95853993229,2cyclictest0-21swapper/309:22:593
95851993229,2cyclictest0-21swapper/210:44:562
95851993229,2cyclictest0-21swapper/208:41:582
95851993229,2cyclictest0-21swapper/208:02:592
9585199320,30cyclictest0-21swapper/207:34:592
9585199320,2cyclictest0-21swapper/209:18:002
95848993228,2cyclictest0-21swapper/111:05:141
95848993224,5cyclictest0-21swapper/108:20:131
95848993224,5cyclictest0-21swapper/108:20:131
95846993229,2cyclictest714-21Xorg12:02:580
95846993227,4cyclictest192351-21systemd-run12:10:010
9584699320,31cyclictest0-21swapper/011:00:130
9585199310,30cyclictest0-21swapper/210:34:582
95848993127,3cyclictest97351-21perf07:19:551
95848993123,7cyclictest187574-21kworker/u8:2+flush-179:012:05:211
95853993028,1cyclictest0-21swapper/311:31:003
95851993027,2cyclictest0-21swapper/210:39:542
9584699300,29cyclictest714-21Xorg11:57:590
4577091300,7ptp4l441ktimers/307:55:013
95853992927,1cyclictest0-21swapper/308:27:593
95853992926,2cyclictest0-21swapper/311:50:153
95853992926,2cyclictest0-21swapper/309:10:143
95853992926,2cyclictest0-21swapper/309:00:153
95853992926,2cyclictest0-21swapper/308:36:583
95853992925,3cyclictest198705-21turbostat12:30:013
9585399290,28cyclictest0-21swapper/311:40:033
9585399290,28cyclictest0-21swapper/307:45:123
9585399290,27cyclictest0-21swapper/310:00:143
95851992926,2cyclictest0-21swapper/209:21:582
95851992926,2cyclictest0-21swapper/207:36:592
9585199290,27cyclictest0-21swapper/210:50:152
95853992826,1cyclictest0-21swapper/311:25:113
95853992825,2cyclictest0-21swapper/308:20:133
95853992825,2cyclictest0-21swapper/308:20:133
95853992825,2cyclictest0-21swapper/308:05:153
95853992823,4cyclictest127872-21turbostat08:50:013
9585399280,26cyclictest0-21swapper/312:30:143
9585399280,26cyclictest0-21swapper/312:30:143
9585399280,26cyclictest0-21swapper/311:05:133
9585399280,26cyclictest0-21swapper/307:15:143
9585399280,1cyclictest0-21swapper/308:30:133
95851992825,2cyclictest0-21swapper/211:20:152
95851992825,2cyclictest0-21swapper/211:15:152
95851992825,2cyclictest0-21swapper/209:50:122
9585199280,26cyclictest0-21swapper/212:05:142
9585199280,26cyclictest0-21swapper/211:28:592
9585199280,26cyclictest0-21swapper/209:40:122
95846992825,2cyclictest142197-21ls09:35:000
4577091280,6ptp4l441ktimers/310:05:003
4577091280,6ptp4l441ktimers/307:15:003
95853992726,1cyclictest0-21swapper/307:25:143
95853992726,1cyclictest0-21swapper/307:25:143
95853992725,1cyclictest0-21swapper/311:45:143
95853992725,1cyclictest0-21swapper/309:51:583
95853992725,1cyclictest0-21swapper/307:44:553
95853992724,2cyclictest0-21swapper/312:20:593
95853992724,2cyclictest0-21swapper/310:53:593
95853992724,2cyclictest0-21swapper/309:59:003
95853992724,2cyclictest0-21swapper/309:59:003
9585399270,1cyclictest0-21swapper/309:15:123
95851992725,1cyclictest0-21swapper/207:30:002
95851992725,1cyclictest0-21swapper/207:30:002
95851992724,2cyclictest0-21swapper/211:14:552
9585199270,1cyclictest0-21swapper/211:49:582
4577091270,7ptp4l441ktimers/310:35:003
4577091270,6ptp4l61490irq/134-eno1-TxRx-012:20:003
4577091270,6ptp4l441ktimers/312:15:003
4577091270,6ptp4l441ktimers/311:20:003
4577091270,6ptp4l441ktimers/311:00:013
4577091270,6ptp4l441ktimers/309:40:013
4577091270,5ptp4l61490irq/134-eno1-TxRx-012:40:003
4577091270,4ptp4l441ktimers/311:10:023
95853992624,1cyclictest0-21swapper/309:32:593
95851992623,2cyclictest0-21swapper/210:59:002
95851992623,2cyclictest0-21swapper/209:35:132
95851992623,2cyclictest0-21swapper/209:01:592
95851992623,2cyclictest0-21swapper/207:10:162
9585199260,2cyclictest0-21swapper/212:30:142
9585199260,2cyclictest0-21swapper/212:30:142
9585199260,2cyclictest0-21swapper/208:17:592
9585199260,2cyclictest0-21swapper/207:42:592
9585199260,24cyclictest0-21swapper/212:16:582
9585199260,24cyclictest0-21swapper/207:21:422
95846992622,3cyclictest121101-21mailstats08:25:230
4577091260,5ptp4l441ktimers/310:50:013
4577091260,5ptp4l441ktimers/307:25:003
9585399250,24cyclictest0-21swapper/309:40:593
95851992523,1cyclictest0-21swapper/208:37:592
95851992522,2cyclictest0-21swapper/208:55:592
9585199250,2cyclictest0-21swapper/210:05:142
9585199250,1cyclictest0-21swapper/209:33:262
4577091250,5ptp4l61490irq/134-eno1-TxRx-012:10:003
4577091250,5ptp4l441ktimers/308:19:563
4577091250,5ptp4l441ktimers/307:39:553
4577091250,4ptp4l441ktimers/312:00:003
4577091250,4ptp4l441ktimers/310:39:553
4577091250,4ptp4l441ktimers/309:49:563
95851992422,1cyclictest0-21swapper/211:41:592
95851992420,2cyclictest0-21swapper/207:55:132
95851992321,1cyclictest0-21swapper/207:19:292
231999220,13rtkit-daemon23940-21sendmail-mta07:07:571
95851992119,1cyclictest0-21swapper/210:21:592
95851992118,2cyclictest0-21swapper/211:54:552
95851992017,2cyclictest0-21swapper/207:49:552
95851991816,1cyclictest0-21swapper/210:04:592
95846991510,4cyclictest0-21swapper/007:10:020
958519985,2cyclictest0-21swapper/209:10:502
958519931,1cyclictest0-21swapper/207:10:022
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional