You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-21 - 11:42
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack6slot0.osadl.org (updated Fri Nov 21, 2025 01:00:31)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
39487992770,3cyclictest33154-21inotify_reader19:15:1939
39487992770,3cyclictest33154-21inotify_reader19:15:1939
3947899254229,4cyclictest351rcuc/222:55:2012
3947899254229,4cyclictest351rcuc/222:55:2012
3947899254229,4cyclictest351rcuc/222:55:2012
3949199230199,13cyclictest0-21swapper/1322:00:185
3949199230199,13cyclictest0-21swapper/1322:00:185
3949199230199,13cyclictest0-21swapper/1322:00:185
394939922134,167cyclictest11905-21CPU7
394939922134,167cyclictest11905-21CPU7
394899921657,152cyclictest11903-21CPU3
394899921657,152cyclictest11903-21CPU3
394899921657,152cyclictest11903-21CPU3
3947899213206,3cyclictest38031-21inotify_reader21:25:1712
3947899213206,3cyclictest38031-21inotify_reader21:25:1712
394779921320,189cyclictest10767-21inotify_reader21:25:181
394779921320,189cyclictest10767-21inotify_reader21:25:181
3948199209197,9cyclictest0-21swapper/521:51:1435
3948199209197,9cyclictest0-21swapper/521:51:1435
3947899208203,3cyclictest0-21swapper/220:00:2012
3947899208203,3cyclictest0-21swapper/220:00:1912
39510992071,14cyclictest0-21swapper/2919:20:1722
39510992071,14cyclictest0-21swapper/2919:20:1722
39489992051,145cyclictest0-21swapper/1122:15:193
39489992051,145cyclictest0-21swapper/1122:15:193
394899920361,136cyclictest4908-21CPU3
394899920361,136cyclictest4908-21CPU3
3947899203198,4cyclictest0-21swapper/221:35:1412
3947899203198,4cyclictest0-21swapper/221:35:1312
3947899202191,7cyclictest3079-21CPU12
3947899202191,7cyclictest3079-21CPU12
395229919741,146cyclictest39590-21TaskSchedulerSi21:20:2132
395229919741,146cyclictest39590-21TaskSchedulerSi21:20:2132
3951899196192,3cyclictest0-21swapper/3520:35:1929
3951899196192,3cyclictest0-21swapper/3520:35:1929
39479991962,87cyclictest15981-21CPU23
39479991962,87cyclictest15981-21CPU23
39479991962,87cyclictest15981-21CPU23
395039919532,146cyclictest4630-21CPU17
395039919532,146cyclictest4630-21CPU17
395229919448,137cyclictest17284-21NetworkChangeNo21:45:2032
395229919448,137cyclictest17284-21NetworkChangeNo21:45:2032
3948499194187,3cyclictest4905-21CPU37
3948499194187,3cyclictest4905-21CPU37
395229919398,52cyclictest0-21swapper/3820:55:2532
395229919398,52cyclictest0-21swapper/3820:55:2532
394779919315,109cyclictest31380-21NetworkChangeNo22:15:191
394779919315,109cyclictest31380-21NetworkChangeNo22:15:191
394929919244,135cyclictest0-21swapper/1421:50:236
394929919244,135cyclictest0-21swapper/1421:50:236
39503991916,113cyclictest38097-21TaskSchedulerSi20:30:2417
39503991901,167cyclictest0-21swapper/2422:40:1917
39503991901,167cyclictest0-21swapper/2422:40:1917
39503991901,167cyclictest0-21swapper/2422:40:1917
3951499189183,3cyclictest0-21swapper/3222:20:2226
3951499189183,3cyclictest0-21swapper/3222:20:2226
3947899189168,13cyclictest0-21swapper/220:05:1812
3947899189168,13cyclictest0-21swapper/220:05:1812
395109918829,103cyclictest5273-21inotify_reader22:20:2122
395109918829,103cyclictest5273-21inotify_reader22:20:2122
394899918759,124cyclictest15979-21CPU3
394899918759,124cyclictest15979-21CPU3
394899918759,124cyclictest15979-21CPU3
3947899187180,4cyclictest0-21swapper/221:43:3512
3947899187180,4cyclictest0-21swapper/221:43:3512
3947899187180,4cyclictest0-21swapper/221:43:3412
394779918735,148cyclictest14635-21TaskSchedulerSi21:50:201
394779918735,148cyclictest14635-21TaskSchedulerSi21:50:201
39479991861,91cyclictest10003-21inotify_reader00:05:1823
39479991861,91cyclictest10003-21inotify_reader00:05:1723
3950799185157,6cyclictest34400-21inotify_reader21:50:1920
3950799185157,6cyclictest34400-21inotify_reader21:50:1920
395049918585,53cyclictest0-21swapper/2500:05:0018
395049918585,53cyclictest0-21swapper/2500:05:0018
3948299185181,2cyclictest0-21swapper/622:10:2536
3948299185181,2cyclictest0-21swapper/622:10:2536
395229918429,143cyclictest0-21swapper/3800:20:2032
395229918429,143cyclictest0-21swapper/3800:20:2032
395049918447,131cyclictest31654-21NetworkChangeNo23:00:1818
395049918447,131cyclictest31654-21NetworkChangeNo23:00:1818
395049918447,131cyclictest31654-21NetworkChangeNo23:00:1818
3948999184153,21cyclictest0-21swapper/1121:45:493
3948999184153,21cyclictest0-21swapper/1121:45:493
3948199184170,12cyclictest0-21swapper/521:36:0335
3948199184170,12cyclictest0-21swapper/521:36:0335
394899918398,72cyclictest25905-21inotify_reader21:40:193
394899918398,72cyclictest25905-21inotify_reader21:40:193
394899918398,72cyclictest25905-21inotify_reader21:40:193
3948199183172,9cyclictest0-21swapper/522:57:3735
3948199183172,9cyclictest0-21swapper/522:57:3735
3948199183172,9cyclictest0-21swapper/522:57:3635
3948499182173,6cyclictest0-21swapper/723:21:1837
3948499182173,6cyclictest0-21swapper/723:21:1837
3947899182109,69cyclictest4632-21CPU12
3947899182109,69cyclictest4632-21CPU12
3950399181105,68cyclictest5176-21TaskSchedulerSi23:45:1817
3950399181105,68cyclictest5176-21TaskSchedulerSi23:45:1817
3950399181105,68cyclictest5176-21TaskSchedulerSi23:45:1817
394959918121,146cyclictest11898-21CPU9
394959918121,146cyclictest11898-21CPU9
39493991811,176cyclictest14868-21TaskSchedulerSi23:25:187
39493991811,176cyclictest14868-21TaskSchedulerSi23:25:187
3949299181109,54cyclictest12077-21NetworkChangeNo20:45:216
3949299181109,54cyclictest12077-21NetworkChangeNo20:45:206
39503991801,170cyclictest0-21swapper/2421:25:1817
39503991801,170cyclictest0-21swapper/2421:25:1817
395029918035,137cyclictest21181-21inotify_reader22:30:2016
395029918035,137cyclictest21181-21inotify_reader22:30:2016
395029918013,147cyclictest4908-21CPU16
395029918013,147cyclictest4908-21CPU16
395029918013,147cyclictest4908-21CPU16
39495991801,172cyclictest0-21swapper/1721:35:199
39495991801,172cyclictest0-21swapper/1721:35:199
3949299180107,70cyclictest17289-21inotify_reader22:15:206
3949299180107,70cyclictest17289-21inotify_reader22:15:206
3947899180157,14cyclictest30584-21bash23:18:0812
3947899180157,14cyclictest30584-21bash23:18:0812
3950599179166,11cyclictest15312-21kworker/u81:3-writeback22:59:3419
3950599179166,11cyclictest15312-21kworker/u81:3-writeback22:59:3419
3950599179166,11cyclictest15312-21kworker/u81:3-writeback22:59:3419
394899917962,112cyclictest0-21swapper/1119:15:183
394899917962,112cyclictest0-21swapper/1119:15:183
3948499179172,6cyclictest0-21swapper/722:01:3937
3948499179172,6cyclictest0-21swapper/722:01:3937
3948499179172,6cyclictest0-21swapper/722:01:3937
395039917893,75cyclictest31048-21inotify_reader20:05:1817
395039917893,75cyclictest31048-21inotify_reader20:05:1817
394899917846,124cyclictest15980-21CPU3
394899917846,124cyclictest15980-21CPU3
3947899178173,4cyclictest0-21swapper/222:35:3912
3947899178173,4cyclictest0-21swapper/222:35:3912
3950599176112,43cyclictest171rcu_preempt00:27:4219
3950599176112,43cyclictest171rcu_preempt00:27:4219
394959917633,129cyclictest3078-21CPU9
394959917633,129cyclictest3078-21CPU9
394959917633,129cyclictest3078-21CPU9
39495991761,7cyclictest0-21swapper/1721:25:189
39495991761,7cyclictest0-21swapper/1721:25:189
39492991761,155cyclictest0-21swapper/1423:55:176
39492991761,155cyclictest0-21swapper/1423:55:176
39492991761,155cyclictest0-21swapper/1423:55:176
394799917638,116cyclictest12104-21inotify_reader20:30:2423
395229917543,36cyclictest11905-21CPU32
395229917543,36cyclictest11905-21CPU32
395229917543,36cyclictest11905-21CPU32
3951599175162,11cyclictest21921-21sshd21:27:2027
3951599175162,11cyclictest21921-21sshd21:27:2027
3950299175171,2cyclictest0-21swapper/2320:35:1516
3950299175171,2cyclictest0-21swapper/2320:35:1516
39499991751,16cyclictest0-21swapper/2122:15:2014
39499991751,16cyclictest0-21swapper/2122:15:2014
39492991751,74cyclictest0-21swapper/1420:30:256
394899917511,139cyclictest18028-21inotify_reader22:45:193
394899917511,139cyclictest18028-21inotify_reader22:45:193
394899917511,139cyclictest18028-21inotify_reader22:45:193
39480991751,5cyclictest0-21swapper/422:35:1934
39480991751,5cyclictest0-21swapper/422:35:1934
394789917597,47cyclictest0-21swapper/221:47:0612
394789917597,47cyclictest0-21swapper/221:47:0612
39513991748,7cyclictest16579-21inotify_reader21:25:1825
39513991748,7cyclictest16579-21inotify_reader21:25:1825
395139917428,77cyclictest35968-21TaskSchedulerSi23:40:1925
395139917428,77cyclictest35968-21TaskSchedulerSi23:40:1925
395049917454,28cyclictest0-21swapper/2522:20:1818
395049917454,28cyclictest0-21swapper/2522:20:1818
39499991746,165cyclictest0-21swapper/2100:25:1914
39499991746,165cyclictest0-21swapper/2100:25:1914
394999917433,109cyclictest11903-21CPU14
394999917433,109cyclictest11903-21CPU14
39499991741,6cyclictest0-21swapper/2120:25:2014
39499991741,6cyclictest0-21swapper/2120:25:2014
394899917492,78cyclictest12196-21inotify_reader22:10:253
394899917492,78cyclictest12196-21inotify_reader22:10:253
39479991743,161cyclictest28458-21NetworkChangeNo22:40:2023
39479991743,161cyclictest28458-21NetworkChangeNo22:40:2023
39479991743,161cyclictest28458-21NetworkChangeNo22:40:1923
3947899174171,2cyclictest351rcuc/220:45:1812
3947899174171,2cyclictest351rcuc/220:45:1712
395029917320,81cyclictest11338-21inotify_reader21:35:2016
395029917320,81cyclictest11338-21inotify_reader21:35:2016
394899917348,104cyclictest6937-21inotify_reader20:30:243
3948499173168,3cyclictest0-21swapper/722:20:2137
3948499173168,3cyclictest0-21swapper/722:20:2137
3947899173167,3cyclictest0-21swapper/219:20:1712
3947899173167,3cyclictest0-21swapper/219:20:1712
3947899173165,6cyclictest0-21swapper/223:35:0212
3947899173165,6cyclictest0-21swapper/223:35:0212
3947899173155,15cyclictest1529-21systemd-logind23:03:5112
3947899173155,15cyclictest1529-21systemd-logind23:03:5112
3947899173155,15cyclictest1529-21systemd-logind23:03:5012
39503991729,76cyclictest21538-21inotify_reader20:55:2517
39503991729,76cyclictest21538-21inotify_reader20:55:2517
394929917256,99cyclictest4654-21inotify_reader21:55:216
394929917256,99cyclictest4654-21inotify_reader21:55:216
394929917256,99cyclictest4654-21inotify_reader21:55:206
39492991723,144cyclictest0-21swapper/1422:40:206
39492991723,144cyclictest0-21swapper/1422:40:206
39492991723,144cyclictest0-21swapper/1422:40:196
3949299172107,58cyclictest31360-21inotify_reader00:10:216
3949299172107,58cyclictest31360-21inotify_reader00:10:216
39479991729,122cyclictest0-21swapper/322:05:1723
39479991729,122cyclictest0-21swapper/322:05:1723
3947899172166,5cyclictest0-21swapper/221:00:5112
3947899172166,5cyclictest0-21swapper/221:00:5112
3947899172162,6cyclictest0-21swapper/222:15:3812
3947899172162,6cyclictest0-21swapper/222:15:3712
3947899172159,10cyclictest0-21swapper/220:50:1612
3947899172159,10cyclictest0-21swapper/220:50:1612
3947899172152,13cyclictest15982-21CPU12
3947899172152,13cyclictest15982-21CPU12
395129917145,8cyclictest27584-21inotify_reader21:05:1824
395129917145,8cyclictest27584-21inotify_reader21:05:1824
3950599171164,5cyclictest0-21swapper/2619:55:3619
3950599171164,5cyclictest0-21swapper/2619:55:3619
3950599171122,10cyclictest171rcu_preempt19:51:4119
3950599171122,10cyclictest171rcu_preempt19:51:4119
394879917134,117cyclictest4908-21CPU39
394879917134,117cyclictest4908-21CPU39
394879917134,117cyclictest4908-21CPU39
3947899171163,6cyclictest0-21swapper/223:50:5612
3947899171163,6cyclictest0-21swapper/223:50:5512
394899917053,113cyclictest15978-21CPU3
394899917053,113cyclictest15978-21CPU3
394899917053,113cyclictest15978-21CPU3
39489991701,165cyclictest15984-21CPU3
39489991701,165cyclictest15984-21CPU3
3947899170124,22cyclictest0-21swapper/221:32:4612
3947899170124,22cyclictest0-21swapper/221:32:4612
3950599169151,16cyclictest0-21swapper/2621:26:0619
3950599169151,16cyclictest0-21swapper/2621:26:0619
394999916919,139cyclictest11628-21inotify_reader20:50:1914
394999916919,139cyclictest11628-21inotify_reader20:50:1914
39495991696,158cyclictest10091-21inotify_reader23:25:189
39495991696,158cyclictest10091-21inotify_reader23:25:189
394929916995,60cyclictest4911-21CPU6
394929916995,60cyclictest4911-21CPU6
394929916968,99cyclictest15663-21inotify_reader19:20:176
394929916968,99cyclictest15663-21inotify_reader19:20:176
3948999169117,48cyclictest15985-21CPU3
3948999169117,48cyclictest15985-21CPU3
3948999169117,48cyclictest15985-21CPU3
3947899169163,5cyclictest0-21swapper/220:25:2212
3947899169163,5cyclictest0-21swapper/220:25:2212
3947899169161,6cyclictest0-21swapper/223:43:1012
3947899169161,6cyclictest0-21swapper/223:43:0912
39477991691,6cyclictest0-21swapper/120:35:181
39477991691,6cyclictest0-21swapper/120:35:181
3950599168150,8cyclictest0-21swapper/2623:06:5119
3950599168150,8cyclictest0-21swapper/2623:06:5119
3950599168150,8cyclictest0-21swapper/2623:06:5119
3950599168149,8cyclictest0-21swapper/2621:11:2019
3950599168149,8cyclictest0-21swapper/2621:11:2019
3949699168138,26cyclictest11901-21CPU10
3949699168138,26cyclictest11901-21CPU10
3949699168138,26cyclictest11901-21CPU10
394929916888,66cyclictest8750-21inotify_reader19:55:206
394929916888,66cyclictest8750-21inotify_reader19:55:196
39492991681,88cyclictest0-21swapper/1400:00:166
39492991681,88cyclictest0-21swapper/1400:00:166
3948999168140,25cyclictest0-21swapper/1120:22:433
3948999168140,25cyclictest0-21swapper/1120:22:433
3948999168114,41cyclictest0-21swapper/1100:30:173
3948999168114,41cyclictest0-21swapper/1100:30:173
394879916862,103cyclictest0-21swapper/923:25:1839
394879916862,103cyclictest0-21swapper/923:25:1839
39487991685,8cyclictest30894-21NetworkChangeNo21:10:1939
39487991685,8cyclictest30894-21NetworkChangeNo21:10:1939
394879916819,133cyclictest0-21swapper/920:10:2239
394879916819,133cyclictest0-21swapper/920:10:2239
394819916832,126cyclictest0-21swapper/522:40:1935
394819916832,126cyclictest0-21swapper/522:40:1935
394819916832,126cyclictest0-21swapper/522:40:1935
3948199168156,7cyclictest0-21swapper/522:24:4535
3948199168156,7cyclictest0-21swapper/522:24:4535
39479991681,159cyclictest0-21swapper/300:20:1923
39479991681,159cyclictest0-21swapper/300:20:1923
3947899168157,4cyclictest37-21ksoftirqd/221:11:0112
3947899168157,4cyclictest37-21ksoftirqd/221:11:0112
3947899168153,13cyclictest0-21swapper/222:25:4812
3947899168153,13cyclictest0-21swapper/222:25:4812
3947899168153,13cyclictest0-21swapper/222:25:4812
3947899168153,13cyclictest0-21swapper/222:25:4812
3950899167162,4cyclictest0-21swapper/2821:25:4421
3950899167162,4cyclictest0-21swapper/2821:25:4421
39495991676,154cyclictest15979-21CPU9
39495991676,154cyclictest15979-21CPU9
3949299167124,31cyclictest0-21swapper/1421:27:086
3949299167124,31cyclictest0-21swapper/1421:27:076
394899916760,97cyclictest0-21swapper/1121:00:203
394899916760,97cyclictest0-21swapper/1121:00:203
394899916727,128cyclictest4634-21CPU3
394899916727,128cyclictest4634-21CPU3
394819916762,48cyclictest0-21swapper/520:35:0135
39479991671,97cyclictest8710-21TaskSchedulerSi19:55:1923
39479991671,97cyclictest8710-21TaskSchedulerSi19:55:1823
3947899167164,2cyclictest351rcuc/222:49:3512
3947899167164,2cyclictest351rcuc/222:49:3512
3947899167164,2cyclictest351rcuc/222:49:3412
3947899167157,7cyclictest4632-21CPU12
3947899167157,7cyclictest4632-21CPU12
34172991670,4rtkit-daemon15979-21CPU33
34172991670,4rtkit-daemon15979-21CPU33
3951999166162,2cyclictest0-21swapper/3620:35:1830
3951999166162,2cyclictest0-21swapper/3620:35:1830
3951999166156,4cyclictest11899-21CPU30
3951999166156,4cyclictest11899-21CPU30
3950899166160,4cyclictest36794-21nfsd00:00:2821
3950899166160,4cyclictest36794-21nfsd00:00:2821
3950899166154,10cyclictest36796-21nfsd00:31:0621
3950899166154,10cyclictest36796-21nfsd00:31:0621
3950599166136,25cyclictest9334-21CPU19
3950599166136,25cyclictest9334-21CPU19
394949916616,144cyclictest4635-21CPU8
394949916616,144cyclictest4635-21CPU8
394949916616,144cyclictest4635-21CPU8
394899916673,62cyclictest35025-21inotify_reader21:25:183
394899916673,62cyclictest35025-21inotify_reader21:25:183
394849916681,81cyclictest11905-21CPU37
394849916681,81cyclictest11905-21CPU37
394849916681,81cyclictest11905-21CPU37
394849916681,81cyclictest11905-21CPU37
3947899166160,5cyclictest0-21swapper/223:10:4112
3947899166160,5cyclictest0-21swapper/223:10:4112
3947899166160,5cyclictest0-21swapper/223:10:4112
3947899166159,5cyclictest0-21swapper/223:06:1912
3947899166159,5cyclictest0-21swapper/223:06:1912
3947899166159,5cyclictest0-21swapper/223:06:1912
3947899166154,3cyclictest0-21swapper/223:48:5712
3947899166154,3cyclictest0-21swapper/223:48:5712
3947899166154,3cyclictest0-21swapper/223:48:5612
3947899166150,14cyclictest0-21swapper/221:25:0412
3947899166150,14cyclictest0-21swapper/221:25:0412
3947899166147,16cyclictest0-21swapper/200:10:2712
3947899166147,16cyclictest0-21swapper/200:10:2712
39477991662,6cyclictest28931-21NetworkChangeNo22:10:241
39477991662,6cyclictest28931-21NetworkChangeNo22:10:231
3952299165135,16cyclictest0-21swapper/3821:12:0832
3952299165135,16cyclictest0-21swapper/3821:12:0832
39515991650,18cyclictest2861rcuc/3300:05:1827
39515991650,18cyclictest2861rcuc/3300:05:1827
3950899165157,5cyclictest0-21swapper/2823:20:2121
3950899165157,5cyclictest0-21swapper/2823:20:2121
3950599165150,13cyclictest0-21swapper/2621:32:4519
3950599165150,13cyclictest0-21swapper/2621:32:4519
39502991651,159cyclictest0-21swapper/2322:00:1916
39502991651,159cyclictest0-21swapper/2322:00:1916
39502991651,159cyclictest0-21swapper/2322:00:1916
3948899165161,2cyclictest0-21swapper/1022:50:182
3948899165161,2cyclictest0-21swapper/1022:50:172
3948899165161,2cyclictest0-21swapper/1022:50:172
394879916533,112cyclictest23424-21inotify_reader19:10:1939
394879916533,112cyclictest23424-21inotify_reader19:10:1939
39484991651,30cyclictest0-21swapper/700:05:1837
39484991651,30cyclictest0-21swapper/700:05:1837
3948199165153,10cyclictest0-21swapper/521:13:2835
3948199165153,10cyclictest0-21swapper/521:13:2835
3947899165150,12cyclictest1761-21sshd00:17:3912
3947899165150,12cyclictest1761-21sshd00:17:3912
3947899165150,12cyclictest1761-21sshd00:17:3812
3947899165123,27cyclictest0-21swapper/222:10:1912
3947899165123,27cyclictest0-21swapper/222:10:1812
3947899165110,11cyclictest171rcu_preempt23:39:1912
3947899165110,11cyclictest171rcu_preempt23:39:1912
3950599164120,17cyclictest171rcu_preempt20:09:4319
3950599164120,17cyclictest171rcu_preempt20:09:4319
3950499164116,28cyclictest0-21swapper/2523:55:2018
3950499164116,28cyclictest0-21swapper/2523:55:2018
3950499164116,28cyclictest0-21swapper/2523:55:2018
3949799164154,6cyclictest0-21swapper/1900:30:0011
3949799164154,6cyclictest0-21swapper/1900:30:0011
3949299164115,35cyclictest0-21swapper/1400:25:376
3949299164115,35cyclictest0-21swapper/1400:25:376
3947899164149,12cyclictest0-21swapper/223:57:5212
3947899164149,12cyclictest0-21swapper/223:57:5212
3947899164149,12cyclictest0-21swapper/223:57:5212
3947899164136,18cyclictest37-21ksoftirqd/200:38:0912
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional