You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-12-04 - 06:40
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack6slot0.osadl.org (updated Thu Dec 04, 2025 01:01:08)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1269899314307,3cyclictest0-21swapper/1923:34:3611
1269899314307,3cyclictest0-21swapper/1923:34:3511
1269899314307,3cyclictest0-21swapper/1923:34:3511
12665992642,237cyclictest11903-21CPU12
12665992642,237cyclictest11903-21CPU12
1269899262221,21cyclictest15979-21CPU11
1269899262221,21cyclictest15979-21CPU11
1269899262221,21cyclictest15979-21CPU11
1268199227183,27cyclictest0-21swapper/1122:20:193
1268199227183,27cyclictest0-21swapper/1122:20:193
1268199227183,27cyclictest0-21swapper/1122:20:193
1268199211177,21cyclictest0-21swapper/1122:45:183
1268199211177,21cyclictest0-21swapper/1122:45:183
1268199211177,21cyclictest0-21swapper/1122:45:183
12716992061,80cyclictest0-21swapper/2620:25:1619
12716992061,80cyclictest0-21swapper/2620:25:1619
1267299204196,6cyclictest0-21swapper/923:49:1139
1267299204196,6cyclictest0-21swapper/923:49:1139
1267299204196,6cyclictest0-21swapper/923:49:1139
1268199201193,6cyclictest0-21swapper/1120:30:283
1268199201193,6cyclictest0-21swapper/1120:30:283
1273399198190,7cyclictest0-21swapper/3521:35:2029
1273399198190,7cyclictest0-21swapper/3521:35:2029
12692991961,4cyclictest0-21swapper/1523:55:187
12692991961,4cyclictest0-21swapper/1523:55:187
12692991961,4cyclictest0-21swapper/1523:55:187
1266599196161,30cyclictest0-21swapper/223:55:2612
1266599196161,30cyclictest0-21swapper/223:55:2512
1266599196161,30cyclictest0-21swapper/223:55:2512
12668991951,191cyclictest0-21swapper/500:00:0035
12668991951,191cyclictest0-21swapper/500:00:0035
12668991951,191cyclictest0-21swapper/500:00:0035
12736991941,5cyclictest0-21swapper/3820:05:2132
12736991941,5cyclictest0-21swapper/3820:05:2132
1267099194139,47cyclictest0-21swapper/721:54:5437
1267099194139,47cyclictest0-21swapper/721:54:5337
1267099194139,47cyclictest0-21swapper/721:54:5337
12665991931,174cyclictest0-21swapper/221:10:1812
12665991931,174cyclictest0-21swapper/221:10:1812
12713991921,186cyclictest0-21swapper/2520:45:2018
1268199191181,8cyclictest0-21swapper/1121:50:443
1268199191181,8cyclictest0-21swapper/1121:50:433
1268199191181,8cyclictest0-21swapper/1121:50:433
1271399190140,41cyclictest0-21swapper/2523:55:2518
1271399190140,41cyclictest0-21swapper/2523:55:2518
1271399190140,41cyclictest0-21swapper/2523:55:2518
12665991900,186cyclictest4905-21CPU12
12717991892,155cyclictest15982-21CPU20
12717991892,155cyclictest15982-21CPU20
12717991892,155cyclictest15982-21CPU20
127169918997,85cyclictest31803-21NetworkChangeNo23:55:1919
127169918997,85cyclictest31803-21NetworkChangeNo23:55:1919
127169918997,85cyclictest31803-21NetworkChangeNo23:55:1819
1269599189184,3cyclictest0-21swapper/1700:35:199
1269599189184,3cyclictest0-21swapper/1700:35:199
1268299189168,11cyclictest0-21swapper/1223:05:554
1268299189168,11cyclictest0-21swapper/1223:05:554
1268299189168,11cyclictest0-21swapper/1223:05:544
12712991881,6cyclictest26841-21TaskSchedulerSi23:55:1917
12712991881,6cyclictest26841-21TaskSchedulerSi23:55:1917
12712991881,6cyclictest26841-21TaskSchedulerSi23:55:1917
1267299188180,4cyclictest0-21swapper/923:38:0339
1267299188180,4cyclictest0-21swapper/923:38:0339
12665991881,88cyclictest0-21swapper/219:40:1912
12665991881,88cyclictest0-21swapper/219:40:1912
12712991871,137cyclictest0-21swapper/2423:45:1817
12712991871,137cyclictest0-21swapper/2423:45:1817
12712991871,137cyclictest0-21swapper/2423:45:1817
1269899186178,6cyclictest0-21swapper/1923:38:4611
1269899186178,6cyclictest0-21swapper/1923:38:4611
1267299186182,2cyclictest0-21swapper/919:35:4339
1267299186182,2cyclictest0-21swapper/919:35:4339
12668991861,130cyclictest15981-21CPU35
12668991861,130cyclictest15981-21CPU35
12668991861,130cyclictest15981-21CPU35
12735991853,38cyclictest0-21swapper/3720:10:1931
12735991853,38cyclictest0-21swapper/3720:10:1831
12716991851,179cyclictest0-21swapper/2621:00:1719
12716991851,179cyclictest0-21swapper/2621:00:1719
127139918595,76cyclictest11905-21CPU18
127139918595,76cyclictest11905-21CPU18
1270999185176,7cyclictest0-21swapper/2221:03:2115
1270999185176,7cyclictest0-21swapper/2221:03:2115
12736991844,176cyclictest0-21swapper/3800:10:2232
12736991844,176cyclictest0-21swapper/3800:10:2132
1271399184149,33cyclictest0-21swapper/2521:15:5118
1271399184149,33cyclictest0-21swapper/2521:15:5118
1267099184121,50cyclictest4908-21CPU37
1267099184121,50cyclictest4908-21CPU37
12716991835,171cyclictest15981-21CPU19
12716991835,171cyclictest15981-21CPU19
12716991831,176cyclictest0-21swapper/2600:35:2219
12716991831,176cyclictest0-21swapper/2600:35:2219
126689918382,90cyclictest31552-21inotify_reader22:35:1835
126689918382,90cyclictest31552-21inotify_reader22:35:1835
126689918295,84cyclictest0-21swapper/523:29:4035
126689918295,84cyclictest0-21swapper/523:29:4035
1271399181140,36cyclictest0-21swapper/2522:18:1318
1271399181140,36cyclictest0-21swapper/2522:18:1218
1270999180171,7cyclictest0-21swapper/2220:05:3515
1270999180171,7cyclictest0-21swapper/2220:05:3515
1270999179169,9cyclictest0-21swapper/2222:06:0315
1270999179169,9cyclictest0-21swapper/2222:06:0315
12660991791,38cyclictest0-21swapper/000:25:210
12660991791,38cyclictest0-21swapper/000:25:200
127179917812,87cyclictest19437-21sh22:05:2220
127179917812,87cyclictest19437-21sh22:05:2120
1267299178140,12cyclictest171rcu_preempt21:35:4139
1267299178140,12cyclictest171rcu_preempt21:35:4139
1267299178102,71cyclictest4910-21CPU39
1266599178147,26cyclictest0-21swapper/222:05:0212
1266599178147,26cyclictest0-21swapper/222:05:0212
1266599178147,26cyclictest0-21swapper/222:05:0212
1273399177172,3cyclictest0-21swapper/3520:45:2129
1269899177171,4cyclictest0-21swapper/1923:45:5411
1269899177171,4cyclictest0-21swapper/1923:45:5411
1269899177171,4cyclictest0-21swapper/1923:45:5411
1268599177163,13cyclictest0-21swapper/1419:15:356
1268599177163,13cyclictest0-21swapper/1419:15:356
12668991771,159cyclictest0-21swapper/500:15:2235
12668991771,159cyclictest0-21swapper/500:15:2235
12668991771,159cyclictest0-21swapper/500:15:2235
12668991770,85cyclictest0-21swapper/500:08:1035
12668991770,85cyclictest0-21swapper/500:08:1035
126669917734,137cyclictest11901-21CPU23
126669917734,137cyclictest11901-21CPU23
1266699177164,10cyclictest34243-21gdbus21:21:4823
1266699177164,10cyclictest34243-21gdbus21:21:4823
126659917778,91cyclictest0-21swapper/222:40:0912
126659917778,91cyclictest0-21swapper/222:40:0912
1273399176120,42cyclictest0-21swapper/3521:15:2729
1273399176120,42cyclictest0-21swapper/3521:15:2729
12717991761,4cyclictest767-21systemd-journal23:50:1920
12717991761,4cyclictest767-21systemd-journal23:50:1820
1271699176140,34cyclictest0-21swapper/2623:41:0819
1271699176140,34cyclictest0-21swapper/2623:41:0819
1271699176140,34cyclictest0-21swapper/2623:41:0819
12716991761,166cyclictest0-21swapper/2621:15:2219
12716991761,166cyclictest0-21swapper/2621:15:2219
127169917610,159cyclictest33900-21inotify_reader23:25:1819
127169917610,159cyclictest33900-21inotify_reader23:25:1819
1271399176112,58cyclictest33899-21NetworkChangeNo21:45:2018
1271399176112,58cyclictest33899-21NetworkChangeNo21:45:2018
1271399176112,58cyclictest33899-21NetworkChangeNo21:45:2018
1271199176168,5cyclictest0-21swapper/2322:33:5516
1271199176168,5cyclictest0-21swapper/2322:33:5516
1271199176168,5cyclictest0-21swapper/2322:33:5516
1270999176164,9cyclictest0-21swapper/2220:50:4015
1267299176172,2cyclictest0-21swapper/900:29:3939
1267299176172,2cyclictest0-21swapper/900:29:3939
1267299176167,7cyclictest0-21swapper/922:17:1139
1267299176167,7cyclictest0-21swapper/922:17:1139
12665991763,164cyclictest0-21swapper/221:09:5912
12665991763,164cyclictest0-21swapper/221:09:5912
12665991761,173cyclictest0-21swapper/219:10:0112
12736991755,109cyclictest19044-21TaskSchedulerSi22:05:2132
12736991755,109cyclictest19044-21TaskSchedulerSi22:05:2132
1273399175168,5cyclictest0-21swapper/3519:49:1629
1273399175168,5cyclictest0-21swapper/3519:49:1629
1273399175165,9cyclictest0-21swapper/3522:31:0429
1273399175165,9cyclictest0-21swapper/3522:31:0429
1273399175165,9cyclictest0-21swapper/3522:31:0429
1273199175115,56cyclictest15980-21CPU28
1273199175115,56cyclictest15980-21CPU28
127299917525,139cyclictest3079-21CPU27
127299917525,139cyclictest3079-21CPU27
127299917525,139cyclictest3079-21CPU27
12717991752,92cyclictest11952-21TaskSchedulerSi20:05:2120
12717991752,92cyclictest11952-21TaskSchedulerSi20:05:2120
127169917587,84cyclictest20792-21NetworkChangeNo22:25:1919
127169917587,84cyclictest20792-21NetworkChangeNo22:25:1919
1271699175154,18cyclictest0-21swapper/2623:19:3319
1271699175154,18cyclictest0-21swapper/2623:19:3319
1271699175154,18cyclictest0-21swapper/2623:19:3319
127129917531,139cyclictest15984-21CPU17
127129917531,139cyclictest15984-21CPU17
12712991751,7cyclictest15979-21CPU17
12712991751,7cyclictest15979-21CPU17
12670991751,92cyclictest0-21swapper/722:05:0337
12670991751,92cyclictest0-21swapper/722:05:0337
12670991751,92cyclictest0-21swapper/722:05:0337
12668991751,164cyclictest15978-21CPU35
12668991751,164cyclictest15978-21CPU35
1266599175105,66cyclictest21773-21inotify_reader20:10:1812
1266599175105,66cyclictest21773-21inotify_reader20:10:1812
1273399174148,8cyclictest3590-21NetworkChangeNo21:45:2029
1273399174148,8cyclictest3590-21NetworkChangeNo21:45:2029
1273399174148,8cyclictest3590-21NetworkChangeNo21:45:2029
1273199174160,12cyclictest0-21swapper/3419:15:3628
1273199174160,12cyclictest0-21swapper/3419:15:3528
127179917493,73cyclictest15957-21qemu-system-x8622:20:1920
127179917493,73cyclictest15957-21qemu-system-x8622:20:1920
127179917493,73cyclictest15957-21qemu-system-x8622:20:1920
12712991747,157cyclictest0-21swapper/2400:05:2117
12712991747,157cyclictest0-21swapper/2400:05:2117
127099917496,70cyclictest9327-21CPU15
127099917496,70cyclictest9327-21CPU15
1269899174135,8cyclictest0-21swapper/1919:54:3711
1269899174135,8cyclictest0-21swapper/1919:54:3711
12668991741,164cyclictest0-21swapper/521:05:1535
12668991741,164cyclictest0-21swapper/521:05:1535
12665991741,169cyclictest0-21swapper/221:40:1912
12665991741,169cyclictest0-21swapper/221:40:1912
12665991741,169cyclictest0-21swapper/221:40:1912
1273399173165,6cyclictest0-21swapper/3523:47:4829
1273399173165,6cyclictest0-21swapper/3523:47:4829
1273399173165,6cyclictest0-21swapper/3523:47:4829
12717991731,3cyclictest21948-21inotify_reader22:45:1820
12717991731,3cyclictest21948-21inotify_reader22:45:1820
12717991731,3cyclictest21948-21inotify_reader22:45:1820
127169917399,65cyclictest36795-21nfsd20:20:2119
127169917399,65cyclictest36795-21nfsd20:20:2119
1270999173161,10cyclictest0-21swapper/2219:22:4915
1270999173161,10cyclictest0-21swapper/2219:22:4815
1268199173167,4cyclictest0-21swapper/1123:40:543
1268199173167,4cyclictest0-21swapper/1123:40:543
1268199173167,4cyclictest0-21swapper/1123:40:543
1267299173149,22cyclictest0-21swapper/922:40:4839
1267299173149,22cyclictest0-21swapper/922:40:4739
12670991730,163cyclictest0-21swapper/723:50:1537
12670991730,163cyclictest0-21swapper/723:50:1437
126679917319,6cyclictest20837-21inotify_reader22:20:1834
126679917319,6cyclictest20837-21inotify_reader22:20:1834
126679917319,6cyclictest20837-21inotify_reader22:20:1834
12665991734,165cyclictest37156-21inotify_reader19:25:1712
12665991734,165cyclictest37156-21inotify_reader19:25:1712
1266599173108,63cyclictest11540-21TaskSchedulerSi21:50:1912
1266599173108,63cyclictest11540-21TaskSchedulerSi21:50:1912
1266599173108,63cyclictest11540-21TaskSchedulerSi21:50:1912
1273199172160,5cyclictest11893-21qemu-system-x8622:02:1128
1273199172160,5cyclictest11893-21qemu-system-x8622:02:1028
1273199172160,5cyclictest11893-21qemu-system-x8622:02:1028
12716991720,169cyclictest0-21swapper/2600:26:3019
12716991720,169cyclictest0-21swapper/2600:26:3019
12713991721,167cyclictest0-21swapper/2523:50:2018
12713991721,167cyclictest0-21swapper/2523:50:2018
127099917299,70cyclictest15982-21CPU15
127099917299,70cyclictest15982-21CPU15
127099917299,70cyclictest15982-21CPU15
1270999172152,7cyclictest0-21swapper/2223:39:3815
1270999172152,7cyclictest0-21swapper/2223:39:3815
1270999172132,18cyclictest171rcu_preempt22:10:1315
1270999172132,18cyclictest171rcu_preempt22:10:1315
1268199172158,11cyclictest0-21swapper/1121:55:273
1268199172158,11cyclictest0-21swapper/1121:55:273
1268199172158,11cyclictest0-21swapper/1121:55:273
1267299172166,4cyclictest0-21swapper/923:52:2239
1267299172166,4cyclictest0-21swapper/923:52:2239
126709917291,77cyclictest4631-21CPU37
126709917291,77cyclictest4631-21CPU37
12670991721,168cyclictest0-21swapper/721:05:1637
12670991721,168cyclictest0-21swapper/721:05:1637
1266999172165,3cyclictest11898-21CPU36
1266999172165,3cyclictest11898-21CPU36
1273399171164,5cyclictest0-21swapper/3520:17:0829
1271699171135,31cyclictest0-21swapper/2622:10:1719
1271699171135,31cyclictest0-21swapper/2622:10:1619
1271699171134,35cyclictest0-21swapper/2623:49:2119
1271699171134,35cyclictest0-21swapper/2623:49:2119
1271699171134,35cyclictest0-21swapper/2623:49:2119
12716991711,167cyclictest0-21swapper/2623:35:2419
12716991711,167cyclictest0-21swapper/2623:35:2419
12716991711,167cyclictest0-21swapper/2600:05:1919
12716991711,167cyclictest0-21swapper/2600:05:1919
1271699171110,51cyclictest0-21swapper/2619:36:4419
1271699171110,51cyclictest0-21swapper/2619:36:4319
1270999171148,16cyclictest171rcu_preempt19:48:4415
1270999171148,16cyclictest171rcu_preempt19:48:4415
1270999171124,44cyclictest11899-21CPU15
1270999171124,44cyclictest11899-21CPU15
1268299171132,11cyclictest0-21swapper/1223:24:444
1268299171132,11cyclictest0-21swapper/1223:24:444
1268299171132,11cyclictest0-21swapper/1223:24:444
1268299171122,27cyclictest0-21swapper/1222:44:514
1268299171122,27cyclictest0-21swapper/1222:44:514
1268299171109,58cyclictest15979-21CPU4
1268299171109,58cyclictest15979-21CPU4
1267299171159,9cyclictest0-21swapper/922:36:0839
1267299171159,9cyclictest0-21swapper/922:36:0839
12670991711,165cyclictest23104-21inotify_reader00:10:2137
12670991711,165cyclictest23104-21inotify_reader00:10:2137
1273399170167,2cyclictest3021rcuc/3523:55:1229
1273399170167,2cyclictest3021rcuc/3523:55:1129
1273399170167,2cyclictest3021rcuc/3523:55:1129
1273399170161,7cyclictest0-21swapper/3519:15:0029
1273399170161,7cyclictest0-21swapper/3519:15:0029
1273199170154,14cyclictest0-21swapper/3421:42:1928
1273199170154,14cyclictest0-21swapper/3421:42:1928
1273199170154,14cyclictest0-21swapper/3421:42:1928
1271699170132,34cyclictest0-21swapper/2621:11:3719
1271699170132,34cyclictest0-21swapper/2621:11:3719
127129917048,118cyclictest11903-21CPU17
127129917048,118cyclictest11903-21CPU17
127129917048,118cyclictest11903-21CPU17
1271199170154,8cyclictest0-21swapper/2322:16:1716
1271199170154,8cyclictest0-21swapper/2322:16:1716
1268599170119,29cyclictest11900-21CPU6
1268599170119,29cyclictest11900-21CPU6
1267299170158,4cyclictest0-21swapper/921:18:0639
1267299170158,4cyclictest0-21swapper/921:18:0539
12670991701,159cyclictest0-21swapper/700:05:2237
12670991701,159cyclictest0-21swapper/700:05:2137
1266899170123,43cyclictest0-21swapper/519:36:2335
1266899170123,43cyclictest0-21swapper/519:36:2335
1266899170119,43cyclictest0-21swapper/522:17:5835
1266899170119,43cyclictest0-21swapper/522:17:5835
1273699169134,30cyclictest0-21swapper/3823:30:3332
1273699169134,30cyclictest0-21swapper/3823:30:3332
1273699169134,30cyclictest0-21swapper/3823:30:3332
1273399169164,4cyclictest0-21swapper/3519:41:2029
1273399169164,4cyclictest0-21swapper/3519:41:2029
1271699169128,39cyclictest0-21swapper/2622:06:4719
1271699169128,39cyclictest0-21swapper/2622:06:4719
1269699169141,12cyclictest0-21swapper/1820:54:0810
126959916968,63cyclictest4637-21CPU9
126959916968,63cyclictest4637-21CPU9
1268299169108,45cyclictest11902-21CPU4
1268299169108,45cyclictest11902-21CPU4
1268299169108,45cyclictest11902-21CPU4
1267299169161,6cyclictest0-21swapper/919:55:4639
126709916999,67cyclictest0-21swapper/722:35:1937
126709916999,67cyclictest0-21swapper/722:35:1937
1266899169117,49cyclictest0-21swapper/500:30:4635
1266899169117,49cyclictest0-21swapper/500:30:4635
1266899169108,58cyclictest0-21swapper/500:12:1435
1266899169108,58cyclictest0-21swapper/500:12:1435
12668991690,64cyclictest0-21swapper/521:40:2135
12668991690,64cyclictest0-21swapper/521:40:2135
12668991690,64cyclictest0-21swapper/521:40:2135
1266699169156,11cyclictest0-21swapper/321:45:2523
1266699169156,11cyclictest0-21swapper/321:45:2523
1266699169156,11cyclictest0-21swapper/321:45:2523
1266599169103,32cyclictest0-21swapper/223:43:1212
1266599169103,32cyclictest0-21swapper/223:43:1212
1266599169103,32cyclictest0-21swapper/223:43:1212
12665991690,163cyclictest0-21swapper/200:17:3112
12665991690,163cyclictest0-21swapper/200:17:3112
12665991690,163cyclictest0-21swapper/200:17:3112
12729991681,20cyclictest30602-21NetworkChangeNo23:50:1927
12729991681,20cyclictest30602-21NetworkChangeNo23:50:1927
12716991681,162cyclictest0-21swapper/2600:00:2019
12716991681,162cyclictest0-21swapper/2600:00:2019
12716991681,162cyclictest0-21swapper/2600:00:2019
12712991684,4cyclictest7579-21inotify_reader00:35:2217
12712991684,4cyclictest7579-21inotify_reader00:35:2117
127099916896,63cyclictest4908-21CPU15
127099916896,63cyclictest4908-21CPU15
127099916896,63cyclictest4908-21CPU15
1270099168163,3cyclictest0-21swapper/2000:29:4913
1270099168163,3cyclictest0-21swapper/2000:29:4913
1268199168164,3cyclictest0-21swapper/1100:30:573
1268199168164,3cyclictest0-21swapper/1100:30:563
1267299168159,7cyclictest0-21swapper/921:51:0739
1267299168159,7cyclictest0-21swapper/921:51:0739
1267299168159,7cyclictest0-21swapper/921:51:0739
1267299168142,8cyclictest0-21swapper/922:06:2239
1267299168142,8cyclictest0-21swapper/922:06:2239
1267299168134,15cyclictest0-21swapper/923:14:3639
1267299168134,15cyclictest0-21swapper/923:14:3539
1267299168134,15cyclictest0-21swapper/923:14:3539
126659916896,66cyclictest0-21swapper/223:24:0412
126659916896,66cyclictest0-21swapper/223:24:0412
126659916896,66cyclictest0-21swapper/223:24:0412
1266599168135,30cyclictest0-21swapper/220:24:0412
1266599168135,30cyclictest0-21swapper/220:24:0412
1266599168108,54cyclictest0-21swapper/219:45:2112
1266599168108,54cyclictest0-21swapper/219:45:2112
12736991671,44cyclictest0-21swapper/3822:45:1832
12736991671,44cyclictest0-21swapper/3822:45:1832
12736991671,44cyclictest0-21swapper/3822:45:1732
127319916764,99cyclictest4905-21CPU28
127319916764,99cyclictest4905-21CPU28
127169916771,93cyclictest137650irq/48-eno1-TxRx-620:55:2019
127169916771,93cyclictest137650irq/48-eno1-TxRx-620:55:2019
12716991670,116cyclictest0-21swapper/2619:24:3119
12716991670,116cyclictest0-21swapper/2619:24:3119
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional