You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-07-12 - 12:46
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rackeslot2.osadl.org (updated Sat Jul 12, 2025 00:43:58)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
10608202970,1sleep10-21swapper/122:15:541
10872972300,1sleep10-21swapper/122:31:251
11086262280,1sleep11108630-21irqrtprio22:45:201
11086262280,1sleep11108630-21irqrtprio22:45:201
25010912618,2phc2sys0-21swapper/320:10:133
25010912518,3phc2sys0-21swapper/322:17:333
25010912518,2phc2sys0-21swapper/323:18:223
99936322417,5sleep30-21swapper/321:40:423
792495992421,1cyclictest0-21swapper/200:00:002
79248499248,15cyclictest0-21swapper/021:25:000
792484992412,6cyclictest0-21swapper/023:20:030
25010912418,3phc2sys0-21swapper/322:13:443
25010912418,3phc2sys0-21swapper/320:25:153
25010912418,2phc2sys0-21swapper/323:06:163
25010912418,2phc2sys0-21swapper/322:58:383
25010912418,2phc2sys0-21swapper/321:57:383
25010912418,2phc2sys0-21swapper/321:47:243
25010912418,2phc2sys0-21swapper/321:36:223
25010912418,2phc2sys0-21swapper/321:34:503
25010912418,2phc2sys0-21swapper/321:26:273
25010912418,2phc2sys0-21swapper/321:16:173
25010912418,2phc2sys0-21swapper/320:54:093
25010912418,2phc2sys0-21swapper/300:27:273
25010912418,2phc2sys0-21swapper/300:16:493
25010912417,3phc2sys0-21swapper/323:37:383
25010912417,2phc2sys0-21swapper/323:33:093
25010912417,2phc2sys0-21swapper/323:00:263
25010912417,2phc2sys0-21swapper/321:24:593
85570622318,3sleep30-21swapper/320:00:153
792484992315,7cyclictest1033287-21kthreadcore22:00:250
25010912318,3phc2sys0-21swapper/320:15:293
25010912318,3phc2sys0-21swapper/320:05:513
25010912318,3phc2sys0-21swapper/319:55:253
25010912318,3phc2sys0-21swapper/319:55:253
25010912317,2phc2sys0-21swapper/323:45:113
25010912317,2phc2sys0-21swapper/323:26:363
25010912317,2phc2sys0-21swapper/323:21:273
25010912317,2phc2sys0-21swapper/322:27:433
25010912317,2phc2sys0-21swapper/321:03:313
25010912317,2phc2sys0-21swapper/319:26:093
25010912317,2phc2sys0-21swapper/319:13:153
25010912317,2phc2sys0-21swapper/300:36:253
94003722218,2sleep30-21swapper/321:07:233
91094422218,2sleep30-21swapper/320:45:193
792489992219,2cyclictest984433-21awk21:35:001
25010912218,2phc2sys0-21swapper/322:03:203
25010912217,3phc2sys0-21swapper/323:57:333
25010912217,3phc2sys0-21swapper/322:41:223
25010912217,3phc2sys0-21swapper/321:53:003
25010912217,3phc2sys0-21swapper/321:11:553
25010912217,3phc2sys0-21swapper/320:57:533
25010912217,3phc2sys0-21swapper/320:35:333
25010912217,3phc2sys0-21swapper/319:44:033
25010912217,3phc2sys0-21swapper/319:32:013
25010912217,3phc2sys0-21swapper/300:21:333
25010912217,3phc2sys0-21swapper/300:08:153
25010912217,1phc2sys0-21swapper/320:20:213
84895522118,2sleep30-21swapper/319:50:493
792484992118,2cyclictest1299710-21cut00:35:010
792484992112,5cyclictest1056988-21kthreadcore22:15:240
792484992111,5cyclictest0-21swapper/022:00:010
25010912117,2phc2sys0-21swapper/319:15:173
25010912115,2phc2sys0-21swapper/322:51:093
25010912114,2phc2sys0-21swapper/322:33:013
115183122117,2sleep30-21swapper/323:10:203
106960322118,2sleep30-21swapper/322:20:583
792495992018,1cyclictest0-21swapper/222:55:012
792489992012,3cyclictest0-21swapper/100:05:011
79248499209,6cyclictest0-21swapper/021:40:270
79248499207,7cyclictest0-21swapper/000:20:120
792484992011,7cyclictest0-21swapper/021:30:020
79191122017,2sleep30-21swapper/319:06:333
25010912017,2phc2sys0-21swapper/323:52:553
25010912017,2phc2sys0-21swapper/323:44:253
25010912017,2phc2sys0-21swapper/320:40:113
25010912017,2phc2sys0-21swapper/320:31:593
25010912017,2phc2sys0-21swapper/319:23:133
25010912017,2phc2sys0-21swapper/300:00:273
25010912015,3phc2sys0-21swapper/322:46:433
25010912015,3phc2sys0-21swapper/322:46:433
126208522017,2sleep30-21swapper/300:10:483
109622322017,2sleep30-21swapper/322:36:373
103839322016,2sleep30-21swapper/322:05:193
924598190,2rtkit-daemon0-21swapper/119:32:441
792495991916,1cyclictest0-21swapper/223:10:002
79248999198,4cyclictest0-21swapper/123:45:121
792489991912,3cyclictest975881-21latency_hist21:30:011
792489991912,3cyclictest1150912-21grep23:10:011
792489991911,4cyclictest1276240-21kthreadcore00:20:201
792484991911,7cyclictest0-21swapper/022:25:130
25010911917,1phc2sys0-21swapper/319:37:013
792495991815,1cyclictest0-21swapper/221:50:012
792495991815,1cyclictest0-21swapper/200:15:272
792495991813,3cyclictest13084762sleep200:40:002
79248999189,4cyclictest0-21swapper/100:15:141
792489991815,2cyclictest1726-21systemd-logind00:10:001
792489991815,2cyclictest1695-21dbus-daemon22:10:001
792489991815,2cyclictest1168497-21latency_hist23:20:011
792489991814,3cyclictest1731-21in:imuxsock23:25:011
792489991814,3cyclictest1003794-21kthreadcore21:45:211
792489991812,1cyclictest501rcuop/221:14:001
792489991810,3cyclictest1153346-21kthreadcore23:10:231
792484991815,2cyclictest984871-21/usr/sbin/munin21:35:230
792484991815,2cyclictest949222-21apt-config21:15:010
792484991815,2cyclictest1-21systemd23:15:010
792484991814,2cyclictest958272-21latency_hist21:20:020
792495991715,1cyclictest0-21swapper/223:40:242
792495991715,1cyclictest0-21swapper/219:30:022
792495991715,1cyclictest0-21swapper/219:10:012
792495991714,1cyclictest0-21swapper/221:50:242
792495991714,1cyclictest0-21swapper/221:15:192
792495991714,1cyclictest0-21swapper/200:30:292
792495991712,1cyclictest0-21swapper/221:20:252
79248999179,1cyclictest191rcu_preempt22:24:381
792489991715,1cyclictest0-21swapper/120:10:021
792489991714,2cyclictest1734-21rs:main1
792489991714,2cyclictest1-21systemd00:00:021
792489991714,2cyclictest1178252-21gltestperf23:25:171
792489991712,1cyclictest178850irq/121-eno122:53:221
79248499179,7cyclictest0-21swapper/022:40:160
79248499178,4cyclictest0-21swapper/022:05:150
79248499177,6cyclictest1312-21hwrng19:25:150
792484991714,2cyclictest922162-21munin-plugin-st20:55:010
792484991714,2cyclictest867573-21runrttasks20:10:010
792484991714,2cyclictest2240602-1atopacctd22:13:360
792484991714,2cyclictest1761-21gdbus00:10:010
792484991714,2cyclictest1186425-21aten_repower_po23:30:140
79248499171,12cyclictest0-21swapper/022:31:450
79248499171,11cyclictest0-21swapper/000:19:130
79248499170,1cyclictest0-21swapper/020:58:370
84313721613,2sleep30-21swapper/319:48:133
79249599161,9cyclictest0-21swapper/220:30:002
792495991614,1cyclictest0-21swapper/222:55:222
792495991614,1cyclictest0-21swapper/220:50:022
792495991613,1cyclictest0-21swapper/223:25:192
792495991613,1cyclictest0-21swapper/222:35:012
792495991613,1cyclictest0-21swapper/222:00:012
792495991613,1cyclictest0-21swapper/221:40:012
792495991613,1cyclictest0-21swapper/221:15:012
792495991613,1cyclictest0-21swapper/220:15:202
792495991613,1cyclictest0-21swapper/219:40:012
792495991612,2cyclictest0-21swapper/222:25:392
792495991611,3cyclictest0-21swapper/220:45:002
792489991614,1cyclictest967054-21cut21:25:011
792489991613,2cyclictest798883-21cpu19:15:011
792489991613,2cyclictest1-21systemd00:30:021
792489991613,2cyclictest1208151-21kthreadcore23:40:201
792489991612,3cyclictest810263-21kthreadcore19:20:191
792489991612,3cyclictest792478-21cyclictest19:15:021
792489991612,3cyclictest1223152-21kthreadcore23:50:221
792489991612,3cyclictest1-21systemd21:00:011
792489991611,1cyclictest601rcuop/322:55:201
792489991610,5cyclictest1032177-21cut22:00:251
792489991610,2cyclictest178850irq/121-eno100:10:181
792489991610,2cyclictest1138814-21processes23:00:241
792489991610,1cyclictest601rcuop/321:41:091
79248499168,7cyclictest0-21swapper/023:50:150
79248499168,2cyclictest0-21swapper/023:15:190
79248499167,4cyclictest0-21swapper/022:20:180
79248499165,6cyclictest0-21swapper/020:27:040
79248499164,7cyclictest1129707-21wc22:55:230
792484991614,2cyclictest837364-21kworker/u16:1+events_freezable_pwr_efficient19:52:310
792484991614,2cyclictest798746-21kworker/u16:3+events_freezable_pwr_efficient19:30:330
79248499161,3cyclictest16-21ksoftirqd/019:44:120
792484991613,2cyclictest904788-21cut20:40:190
792484991613,2cyclictest792478-21cyclictest20:00:250
792484991613,2cyclictest1-21systemd19:49:560
792484991612,3cyclictest1204002-21cpuspeed_turbos23:40:140
924598150,3rtkit-daemon798753-21munin-node20:35:180
792495991513,1cyclictest0-21swapper/221:34:552
792495991513,1cyclictest0-21swapper/221:30:012
792495991513,1cyclictest0-21swapper/200:23:022
792495991512,1cyclictest0-21swapper/223:55:002
792495991512,1cyclictest0-21swapper/223:45:262
792495991512,1cyclictest0-21swapper/222:40:012
792495991512,1cyclictest0-21swapper/222:15:272
792495991512,1cyclictest0-21swapper/222:15:012
792495991512,1cyclictest0-21swapper/220:10:002
79248999157,3cyclictest501rcuop/220:12:041
79248999157,3cyclictest36-21ksoftirqd/121:35:241
79248999157,3cyclictest1100761-21kthreadcore22:40:231
79248999156,3cyclictest501rcuop/219:59:581
79248999156,3cyclictest501rcuop/219:59:581
79248999156,3cyclictest501rcuop/219:35:171
79248999156,3cyclictest501rcuop/200:38:041
79248999156,2cyclictest501rcuop/221:55:521
79248999155,5cyclictest0-21swapper/120:50:261
792489991513,1cyclictest1051433-21sendmail_mailqu22:10:271
792489991512,2cyclictest846659-21kthreadcore19:50:221
792489991512,2cyclictest843300-21awk19:50:001
792489991512,2cyclictest1726-21systemd-logind21:20:031
792489991512,2cyclictest1291766-21cstates00:30:171
792489991511,3cyclictest897014-21mailstats20:30:241
792489991511,3cyclictest889407-21kthreadcore20:25:211
79248999150,3cyclictest0-21swapper/121:50:491
79248499157,3cyclictest940253-21diskmemload23:59:380
79248499155,6cyclictest1195382-21cpuspeed_turbos23:35:200
79248499151,9cyclictest895523-21cut20:30:210
792484991513,1cyclictest120262-21packagekitd22:35:210
792484991512,2cyclictest916034-21cut20:50:000
792484991512,2cyclictest869113-21kthreadcore20:10:210
792484991512,2cyclictest825751-21cpuspeed_turbos19:35:160
792484991512,2cyclictest2240602-1atopacctd21:25:220
792484991512,2cyclictest1305528-21unixbench-2d00:35:270
792484991512,2cyclictest1283413-21head00:25:190
792484991512,2cyclictest1256350-21acpi00:10:130
792484991512,2cyclictest1-21systemd22:45:240
792484991512,2cyclictest1-21systemd22:45:240
792484991512,2cyclictest1182601-21ptp4l23:25:240
792484991512,2cyclictest1150702-21sh23:10:010
792484991512,2cyclictest1003366-21irqcore21:45:190
79249599141,8cyclictest0-21swapper/220:55:002
792495991412,1cyclictest0-21swapper/223:30:162
792495991412,1cyclictest0-21swapper/223:20:212
792495991412,1cyclictest0-21swapper/221:45:012
792495991411,1cyclictest0-21swapper/223:35:262
792495991411,1cyclictest0-21swapper/223:15:262
792495991411,1cyclictest0-21swapper/223:10:222
792495991411,1cyclictest0-21swapper/220:20:192
792495991411,1cyclictest0-21swapper/220:00:222
792495991411,1cyclictest0-21swapper/200:25:242
792495991411,1cyclictest0-21swapper/200:10:222
792495991411,1cyclictest0-21swapper/200:05:192
792495991410,2cyclictest0-21swapper/219:50:192
79249599140,7cyclictest0-21swapper/222:40:162
79249599140,4cyclictest10354302sleep222:02:292
79249599140,10cyclictest0-21swapper/222:10:012
79248999146,3cyclictest501rcuop/221:07:021
79248999146,3cyclictest501rcuop/220:21:021
792489991411,2cyclictest933053-21kthreadcore21:00:231
792489991411,2cyclictest860568-21processes20:00:251
792489991411,2cyclictest792478-21cyclictest20:40:251
792489991411,2cyclictest1200417-21unixbench-2d23:35:311
792489991411,2cyclictest1074739-21kthreadcore22:25:201
792489991410,3cyclictest902936-21pmu-power20:35:251
792489991410,3cyclictest875167-21kthreadcore20:15:201
792489991410,3cyclictest833745-21kthreadcore19:40:241
792489991410,3cyclictest815524-21kthreadcore19:25:211
792489991410,3cyclictest1177326-21kworker/u16:1+nfsiod23:32:191
792489991410,3cyclictest1092866-21kthreadcore22:35:221
79248499147,2cyclictest0-21swapper/022:50:240
79248499146,6cyclictest1-21systemd20:00:010
79248499146,6cyclictest1-21systemd20:00:010
79248499146,4cyclictest0-21swapper/021:00:160
79248499145,5cyclictest0-21swapper/021:05:310
792484991411,2cyclictest880259-21cpuspeed_turbos20:20:180
792484991411,2cyclictest792631-21sh19:10:010
792484991411,2cyclictest1137907-21kthreadcore23:00:210
792484991411,2cyclictest1012149-21sort21:50:230
79249599139,2cyclictest0-21swapper/219:48:482
792495991311,1cyclictest0-21swapper/221:00:192
792495991311,1cyclictest0-21swapper/219:40:242
792495991311,1cyclictest0-21swapper/219:15:012
792495991310,1cyclictest0-21swapper/223:00:202
792495991310,1cyclictest0-21swapper/222:45:182
792495991310,1cyclictest0-21swapper/222:45:182
792495991310,1cyclictest0-21swapper/220:35:152
792495991310,1cyclictest0-21swapper/220:10:222
792495991310,1cyclictest0-21swapper/219:55:172
792495991310,1cyclictest0-21swapper/219:55:172
792495991310,1cyclictest0-21swapper/219:20:012
79249599130,1cyclictest0-21swapper/222:21:332
79249599130,1cyclictest0-21swapper/200:00:152
79248999130,7cyclictest792716-21cat19:10:011
79248499135,3cyclictest792849-21/usr/sbin/munin19:10:240
79248499132,1cyclictest191rcu_preempt23:45:130
792484991310,2cyclictest874128-21cpuspeed_turbos20:15:150
79248499130,8cyclictest800270-21kthreadcore19:15:020
12393812131,4sleep01239570-21gltestperf00:00:190
79249599129,1cyclictest0-21swapper/220:30:202
79249599120,10cyclictest807650-21taskset19:20:132
79248499129,2cyclictest807429-21aten_repower_po19:20:130
2501091120,2phc2sys0-21swapper/300:35:013
79249599119,1cyclictest0-21swapper/221:05:192
79249599111,5cyclictest0-21swapper/219:30:142
79249599110,4cyclictest0-21swapper/220:55:122
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional