You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-12 - 12:22
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack6slot0.osadl.org (updated Wed Nov 12, 2025 01:01:09)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
358499261231,14cyclictest37888-21NetworkChangeNo20:00:2320
358499261231,14cyclictest37888-21NetworkChangeNo20:00:2320
356699238167,67cyclictest11900-21CPU9
356699238167,67cyclictest11900-21CPU9
3608992364,110cyclictest0-21swapper/3923:30:1933
3608992364,110cyclictest0-21swapper/3923:30:1933
3608992364,110cyclictest0-21swapper/3923:30:1933
358499221206,3cyclictest2371rcuc/2721:15:2020
358499221206,3cyclictest2371rcuc/2721:15:2020
3560992171,20cyclictest0-21swapper/1122:25:193
3560992171,20cyclictest0-21swapper/1122:25:193
3560992171,20cyclictest0-21swapper/1122:25:183
3564992161,212cyclictest0-21swapper/1521:15:207
3564992161,212cyclictest0-21swapper/1521:15:207
358499215210,3cyclictest0-21swapper/2720:25:1220
358499215210,3cyclictest0-21swapper/2720:25:1120
359899207136,67cyclictest15982-21CPU27
359899207136,67cyclictest15982-21CPU27
359199200168,8cyclictest11898-21CPU22
359199200168,8cyclictest11898-21CPU22
3568992001,81cyclictest9578-21NetworkChangeNo23:20:2210
3568992001,81cyclictest9578-21NetworkChangeNo23:20:2210
359199197193,2cyclictest0-21swapper/2919:40:2322
359199197193,2cyclictest0-21swapper/2919:40:2322
354999197190,4cyclictest0-21swapper/419:35:3534
354999197190,4cyclictest0-21swapper/419:35:3534
35759919693,88cyclictest15982-21CPU18
35759919693,88cyclictest15982-21CPU18
35759919693,88cyclictest15982-21CPU18
357299196162,21cyclictest0-21swapper/2222:16:5315
357299196162,21cyclictest0-21swapper/2222:16:5315
35709919550,62cyclictest24456-21inotify_reader21:45:1913
35709919550,62cyclictest24456-21inotify_reader21:45:1913
35689919518,89cyclictest9844-21inotify_reader23:50:2010
35689919518,89cyclictest9844-21inotify_reader23:50:1910
35549919564,94cyclictest30055-21inotify_reader00:00:1937
35549919564,94cyclictest30055-21inotify_reader00:00:1937
35549919564,94cyclictest30055-21inotify_reader00:00:1837
354999195178,14cyclictest0-21swapper/421:45:3234
354999195178,14cyclictest0-21swapper/421:45:3234
35959919437,128cyclictest35760-21inotify_reader19:55:1926
35959919437,128cyclictest35760-21inotify_reader19:55:1926
35519919413,5cyclictest9189-21inotify_reader23:15:1836
35519919413,5cyclictest9189-21inotify_reader23:15:1836
357099193111,74cyclictest15978-21CPU13
3565991918,110cyclictest40279-21inotify_reader21:40:208
3565991918,110cyclictest40279-21inotify_reader21:40:208
3565991913,179cyclictest11904-21CPU8
3565991913,179cyclictest11904-21CPU8
3565991913,179cyclictest11904-21CPU8
356199191186,3cyclictest0-21swapper/1223:15:214
356199191186,3cyclictest0-21swapper/1223:15:214
354999191164,13cyclictest0-21swapper/400:26:3434
354999191164,13cyclictest0-21swapper/400:26:3434
35759919018,20cyclictest0-21swapper/2523:35:1918
35759919018,20cyclictest0-21swapper/2523:35:1918
356599189131,54cyclictest0-21swapper/1600:16:318
356599189131,54cyclictest0-21swapper/1600:16:318
356599189131,54cyclictest0-21swapper/1600:16:318
3565991891,106cyclictest0-21swapper/1623:35:198
3565991891,106cyclictest0-21swapper/1623:35:198
35749918869,37cyclictest17271-21TaskSchedulerSi19:45:2217
35749918869,37cyclictest17271-21TaskSchedulerSi19:45:2217
35879918722,91cyclictest31704-21inotify_reader23:50:2021
35879918722,91cyclictest31704-21inotify_reader23:50:1921
358799187130,50cyclictest4635-21CPU21
358799187130,50cyclictest4635-21CPU21
358799187130,50cyclictest4635-21CPU21
35659918582,92cyclictest2191-21TaskSchedulerFo22:28:338
35659918582,92cyclictest2191-21TaskSchedulerFo22:28:338
35659918582,92cyclictest2191-21TaskSchedulerFo22:28:338
355499184103,62cyclictest17617-21inotify_reader00:30:2037
355499184103,62cyclictest17617-21inotify_reader00:30:2037
359499183163,18cyclictest0-21swapper/3122:33:3425
359499183163,18cyclictest0-21swapper/3122:33:3425
359499183163,18cyclictest0-21swapper/3122:33:3425
357299183159,7cyclictest0-21swapper/2222:20:4715
357299183159,7cyclictest0-21swapper/2222:20:4715
357299183159,7cyclictest0-21swapper/2222:20:4615
357299183133,34cyclictest4631-21CPU15
357299183133,34cyclictest4631-21CPU15
3565991838,151cyclictest10880-21inotify_reader20:05:208
3565991831,169cyclictest0-21swapper/1620:35:218
3565991831,169cyclictest0-21swapper/1620:35:208
357599182138,16cyclictest0-21swapper/2523:10:0718
357599182138,16cyclictest0-21swapper/2523:10:0718
3587991811,173cyclictest27825-21inotify_reader20:45:2021
3587991811,173cyclictest27825-21inotify_reader20:45:2021
357299181137,16cyclictest171rcu_preempt19:11:1615
357299180122,34cyclictest171rcu_preempt20:10:2815
3565991801,89cyclictest0-21swapper/1621:50:188
3565991801,89cyclictest0-21swapper/1621:50:188
356599180134,35cyclictest0-21swapper/1623:19:358
356599180134,35cyclictest0-21swapper/1623:19:358
35669917979,94cyclictest36795-21nfsd19:50:189
35669917979,94cyclictest36795-21nfsd19:50:189
356699179120,52cyclictest38235-21TaskSchedulerSi22:50:199
356699179120,52cyclictest38235-21TaskSchedulerSi22:50:199
3566991791,171cyclictest0-21swapper/1720:10:199
3566991791,166cyclictest0-21swapper/1723:30:199
3566991791,166cyclictest0-21swapper/1723:30:199
3566991791,166cyclictest0-21swapper/1723:30:199
35959917851,52cyclictest36795-21nfsd20:00:2326
35959917851,52cyclictest36795-21nfsd20:00:2326
35879917894,77cyclictest19457-21inotify_reader00:05:2021
35879917894,77cyclictest19457-21inotify_reader00:05:2021
35879917894,77cyclictest19457-21inotify_reader00:05:2021
357599178170,5cyclictest0-21swapper/2523:42:0418
357599178170,5cyclictest0-21swapper/2523:42:0418
357599178170,5cyclictest0-21swapper/2523:42:0418
357299178158,12cyclictest0-21swapper/2219:34:3815
357299178158,12cyclictest0-21swapper/2219:34:3815
3568991788,97cyclictest0-21swapper/1819:35:2310
3568991788,97cyclictest0-21swapper/1819:35:2310
358499177157,4cyclictest36796-21nfsd19:40:2020
358499177157,4cyclictest36796-21nfsd19:40:2020
359999176108,44cyclictest35759-21NetworkChangeNo19:50:1828
359999176108,44cyclictest35759-21NetworkChangeNo19:50:1828
3587991762,4cyclictest3078-21CPU21
3587991762,4cyclictest3078-21CPU21
358499176145,17cyclictest0-21swapper/2723:20:2220
358499176145,17cyclictest0-21swapper/2723:20:2220
3551991761,154cyclictest0-21swapper/620:30:1936
3551991761,154cyclictest0-21swapper/620:30:1936
354999176159,10cyclictest0-21swapper/421:22:1934
354999176159,10cyclictest0-21swapper/421:22:1934
354999176159,10cyclictest0-21swapper/421:22:1934
36089917512,81cyclictest13720-21inotify_reader21:50:1933
36089917512,81cyclictest13720-21inotify_reader21:50:1933
35749917536,136cyclictest24479-21bash23:35:1917
35749917536,136cyclictest24479-21bash23:35:1917
35649917516,80cyclictest3857-21NetworkChangeNo23:50:197
35649917516,80cyclictest3857-21NetworkChangeNo23:50:197
357599174161,9cyclictest0-21swapper/2520:25:5718
357599174161,9cyclictest0-21swapper/2520:25:5718
35729917442,114cyclictest0-21swapper/2219:50:1815
35729917442,114cyclictest0-21swapper/2219:50:1815
357099174161,11cyclictest0-21swapper/2021:35:0713
357099174161,11cyclictest0-21swapper/2021:35:0713
357099174161,11cyclictest0-21swapper/2021:35:0713
3566991741,168cyclictest0-21swapper/1723:05:209
3566991741,168cyclictest0-21swapper/1723:05:209
354999174168,4cyclictest0-21swapper/420:45:3834
354999174168,4cyclictest0-21swapper/420:45:3834
354999174158,10cyclictest0-21swapper/419:19:3534
358499173150,12cyclictest3078-21CPU20
358499173150,12cyclictest3078-21CPU20
356699173152,16cyclictest0-21swapper/1721:55:439
356699173152,16cyclictest0-21swapper/1721:55:439
356699173152,16cyclictest0-21swapper/1721:55:439
35499917393,68cyclictest4908-21CPU34
35499917393,68cyclictest4908-21CPU34
35499917393,68cyclictest4908-21CPU34
354499173108,58cyclictest32987-21NetworkChangeNo19:45:220
354499173108,58cyclictest32987-21NetworkChangeNo19:45:220
357599171144,11cyclictest0-21swapper/2500:26:1018
357599171144,11cyclictest0-21swapper/2500:26:1018
355999171164,5cyclictest36792-21nfsd00:10:542
355999171164,5cyclictest36792-21nfsd00:10:542
355999171164,5cyclictest36792-21nfsd00:10:542
3547991719,157cyclictest4633-21CPU23
3547991719,157cyclictest4633-21CPU23
359599170144,13cyclictest0-21swapper/3223:22:0326
359599170144,13cyclictest0-21swapper/3223:22:0326
358499170158,3cyclictest0-21swapper/2720:10:1920
357499170146,8cyclictest0-21swapper/2419:32:4217
357499170146,8cyclictest0-21swapper/2419:32:4217
35669917098,64cyclictest21673-21NetworkChangeNo21:45:199
35669917098,64cyclictest21673-21NetworkChangeNo21:45:199
3547991701,5cyclictest15985-21CPU23
3547991701,5cyclictest15985-21CPU23
3547991701,5cyclictest15985-21CPU23
3608991691,121cyclictest0-21swapper/3919:35:2333
3608991691,121cyclictest0-21swapper/3919:35:2333
360099169125,31cyclictest0-21swapper/3521:01:2629
360099169125,31cyclictest0-21swapper/3521:01:2629
357299169152,11cyclictest0-21swapper/2221:45:5515
357299169152,11cyclictest0-21swapper/2221:45:5515
3565991691,90cyclictest15981-21CPU8
3565991691,90cyclictest15981-21CPU8
3565991691,90cyclictest15981-21CPU8
35959916844,119cyclictest38760-21TaskSchedulerSi20:10:1926
358499168138,18cyclictest0-21swapper/2722:02:0020
358499168138,18cyclictest0-21swapper/2722:02:0020
358499168138,18cyclictest0-21swapper/2722:02:0020
35659916893,66cyclictest13719-21NetworkChangeNo22:10:198
35659916893,66cyclictest13719-21NetworkChangeNo22:10:198
35659916893,66cyclictest13719-21NetworkChangeNo22:10:198
35619916862,95cyclictest4910-21CPU4
35619916862,95cyclictest4910-21CPU4
35619916862,95cyclictest4910-21CPU4
36009916750,102cyclictest8442-21TaskSchedulerSi19:50:1829
36009916750,102cyclictest8442-21TaskSchedulerSi19:50:1829
358499167159,6cyclictest29631-21kworker/u81:3-events_unbound23:51:0820
358499167159,6cyclictest29631-21kworker/u81:3-events_unbound23:51:0820
358499167139,14cyclictest0-21swapper/2721:05:2220
358499167139,14cyclictest0-21swapper/2721:05:2220
358499167139,14cyclictest0-21swapper/2721:05:2220
357499167145,6cyclictest0-21swapper/2421:17:0017
357499167145,6cyclictest0-21swapper/2421:17:0017
357299167150,11cyclictest0-21swapper/2221:28:2015
357299167150,11cyclictest0-21swapper/2221:28:2015
35709916792,56cyclictest0-21swapper/2021:55:1913
35709916792,56cyclictest0-21swapper/2021:55:1913
35709916792,56cyclictest0-21swapper/2021:55:1913
3554991671,156cyclictest0-21swapper/723:25:2137
3554991671,156cyclictest0-21swapper/723:25:2137
3554991671,156cyclictest0-21swapper/723:25:2137
354999167149,16cyclictest0-21swapper/421:52:2734
354999167149,16cyclictest0-21swapper/421:52:2634
354499167137,22cyclictest36796-21nfsd19:40:180
354499167137,22cyclictest36796-21nfsd19:40:180
3603991668,139cyclictest15982-21CPU31
3603991668,139cyclictest15982-21CPU31
3587991665,94cyclictest28458-21NetworkChangeNo20:05:2121
357599166153,11cyclictest0-21swapper/2523:24:1918
357599166153,11cyclictest0-21swapper/2523:24:1918
35729916650,97cyclictest15982-21CPU15
35729916650,97cyclictest15982-21CPU15
357299166155,6cyclictest0-21swapper/2223:22:0515
357299166155,6cyclictest0-21swapper/2223:22:0515
357299166145,11cyclictest0-21swapper/2200:34:2215
357299166145,11cyclictest0-21swapper/2200:34:2215
357299166140,13cyclictest0-21swapper/2221:56:0715
357299166140,13cyclictest0-21swapper/2221:56:0715
357299166140,13cyclictest0-21swapper/2221:56:0715
357099166142,17cyclictest0-21swapper/2023:08:5913
357099166142,17cyclictest0-21swapper/2023:08:5913
3565991661,160cyclictest0-21swapper/1621:15:198
3565991661,160cyclictest0-21swapper/1621:15:198
354999166152,6cyclictest0-21swapper/419:21:1134
354999166152,6cyclictest0-21swapper/419:21:1134
35469916690,67cyclictest3896-21TaskSchedulerSi21:00:2012
35469916690,67cyclictest3896-21TaskSchedulerSi21:00:1912
3594991650,149cyclictest0-21swapper/3123:35:1925
3594991650,149cyclictest0-21swapper/3123:35:1925
3587991651,70cyclictest0-21swapper/2820:10:1921
357599165127,28cyclictest15984-21CPU18
357599165127,28cyclictest15984-21CPU18
35719916516,110cyclictest4906-21CPU14
35719916516,110cyclictest4906-21CPU14
35719916516,110cyclictest4906-21CPU14
3566991653,145cyclictest29026-21inotify_reader20:20:209
354999165124,30cyclictest15980-21CPU34
3608991641,116cyclictest0-21swapper/3923:15:1833
3608991641,116cyclictest0-21swapper/3923:15:1733
360299164157,6cyclictest0-21swapper/3600:10:0030
360299164157,6cyclictest0-21swapper/3600:10:0030
360299164157,6cyclictest0-21swapper/3600:10:0030
35959916456,33cyclictest24263-21cstates23:50:1626
35959916456,33cyclictest24263-21cstates23:50:1626
359599164122,31cyclictest4636-21CPU26
359599164122,31cyclictest4636-21CPU26
35689916446,103cyclictest36793-21nfsd21:45:1910
35689916446,103cyclictest36793-21nfsd21:45:1910
356699164120,36cyclictest0-21swapper/1700:27:109
356699164120,36cyclictest0-21swapper/1700:27:109
3565991641,2cyclictest0-21swapper/1622:20:148
3565991641,2cyclictest0-21swapper/1622:20:148
3565991641,2cyclictest0-21swapper/1622:20:148
356199164152,9cyclictest0-21swapper/1220:30:014
356199164152,9cyclictest0-21swapper/1220:30:014
3608991631,158cyclictest0-21swapper/3920:10:1933
359499163125,35cyclictest0-21swapper/3122:28:1025
359499163125,35cyclictest0-21swapper/3122:28:1025
359499163125,35cyclictest0-21swapper/3122:28:1025
357299163148,4cyclictest0-21swapper/2223:45:4715
357299163148,4cyclictest0-21swapper/2223:45:4615
357299163144,8cyclictest0-21swapper/2223:05:0115
357299163144,8cyclictest0-21swapper/2223:05:0115
357299163144,8cyclictest0-21swapper/2223:05:0115
357299163131,12cyclictest171rcu_preempt00:19:1715
357299163131,12cyclictest171rcu_preempt00:19:1715
357299163131,12cyclictest171rcu_preempt00:19:1715
35669916391,64cyclictest28748-21inotify_reader22:05:229
35669916391,64cyclictest28748-21inotify_reader22:05:229
35669916391,64cyclictest28748-21inotify_reader22:05:229
35669916375,73cyclictest24361-21inotify_reader23:15:199
35669916375,73cyclictest24361-21inotify_reader23:15:199
3565991631,146cyclictest31816-21TaskSchedulerSi23:20:228
3565991631,146cyclictest31816-21TaskSchedulerSi23:20:228
354999163147,7cyclictest0-21swapper/423:41:3034
354999163147,7cyclictest0-21swapper/423:41:3034
354999163147,7cyclictest0-21swapper/423:41:3034
354999163147,12cyclictest0-21swapper/423:24:1934
354999163147,12cyclictest0-21swapper/423:24:1934
3546991631,146cyclictest0-21swapper/220:30:1912
3546991631,146cyclictest0-21swapper/220:30:1912
3608991621,146cyclictest0-21swapper/3921:30:2033
3608991621,146cyclictest0-21swapper/3921:30:2033
3608991621,146cyclictest0-21swapper/3921:30:2033
3593991626,4cyclictest27377-21NetworkChangeNo23:25:2024
3593991626,4cyclictest27377-21NetworkChangeNo23:25:2024
3593991626,4cyclictest27377-21NetworkChangeNo23:25:2024
357399162153,8cyclictest0-21swapper/2323:05:0216
357399162153,8cyclictest0-21swapper/2323:05:0216
357399162153,8cyclictest0-21swapper/2323:05:0216
35719916223,133cyclictest9327-21CPU14
35719916223,133cyclictest9327-21CPU14
3571991621,147cyclictest0-21swapper/2121:10:1914
3571991621,147cyclictest0-21swapper/2121:10:1914
357099162100,42cyclictest0-21swapper/2021:11:4813
357099162100,42cyclictest0-21swapper/2021:11:4813
3568991626,77cyclictest0-21swapper/1819:40:2010
3568991626,77cyclictest0-21swapper/1819:40:2010
356699162113,37cyclictest0-21swapper/1700:10:569
356699162113,37cyclictest0-21swapper/1700:10:569
356699162113,37cyclictest0-21swapper/1700:10:569
356599162127,29cyclictest0-21swapper/1622:09:068
356599162127,29cyclictest0-21swapper/1622:09:068
356599162127,29cyclictest0-21swapper/1622:09:068
355999162154,7cyclictest0-21swapper/1020:05:002
355999162154,7cyclictest0-21swapper/1020:05:002
359499161140,11cyclictest0-21swapper/3122:59:2825
359499161140,11cyclictest0-21swapper/3122:59:2825
359499161140,11cyclictest0-21swapper/3122:59:2825
359499161132,22cyclictest0-21swapper/3122:01:1425
359499161132,22cyclictest0-21swapper/3122:01:1425
359499161132,22cyclictest0-21swapper/3122:01:1425
357599161138,6cyclictest0-21swapper/2500:35:4218
357599161138,6cyclictest0-21swapper/2500:35:4218
357399161150,8cyclictest0-21swapper/2300:23:3116
357399161150,8cyclictest0-21swapper/2300:23:3116
357399161150,8cyclictest0-21swapper/2300:23:3116
357299161148,4cyclictest0-21swapper/2219:21:4815
357299161148,4cyclictest0-21swapper/2219:21:4815
357299161132,12cyclictest0-21swapper/2219:40:4315
357299161132,12cyclictest0-21swapper/2219:40:4315
354999161147,5cyclictest0-21swapper/421:55:5734
354999161147,5cyclictest0-21swapper/421:55:5734
354999161147,5cyclictest0-21swapper/421:55:5634
35959916071,36cyclictest0-21swapper/3219:45:2126
35959916071,36cyclictest0-21swapper/3219:45:2126
35939916034,78cyclictest367921nfsd00:05:2024
35939916034,78cyclictest367921nfsd00:05:2024
35939916034,78cyclictest367921nfsd00:05:2024
358499160137,14cyclictest15984-21CPU20
358499160137,14cyclictest15984-21CPU20
357299160137,9cyclictest0-21swapper/2220:01:0715
357299160137,9cyclictest0-21swapper/2220:01:0715
3571991605,46cyclictest4085-21TaskSchedulerSi23:15:1814
3571991605,46cyclictest4085-21TaskSchedulerSi23:15:1814
356999160120,38cyclictest0-21swapper/1923:43:0811
356999160120,38cyclictest0-21swapper/1923:43:0811
356999160120,38cyclictest0-21swapper/1923:43:0811
3568991601,150cyclictest0-21swapper/1822:10:1910
3568991601,150cyclictest0-21swapper/1822:10:1910
3568991601,150cyclictest0-21swapper/1822:10:1810
35669916076,65cyclictest31048-21inotify_reader23:55:189
35669916076,65cyclictest31048-21inotify_reader23:55:179
35669916076,65cyclictest31048-21inotify_reader23:55:179
3565991605,72cyclictest37888-21NetworkChangeNo20:00:238
3565991605,72cyclictest37888-21NetworkChangeNo20:00:238
35959915967,70cyclictest0-21swapper/3221:50:1826
35959915967,70cyclictest0-21swapper/3221:50:1826
359599159131,18cyclictest0-21swapper/3222:10:3726
359599159131,18cyclictest0-21swapper/3222:10:3726
359599159131,18cyclictest0-21swapper/3222:10:3726
3587991591,52cyclictest0-21swapper/2822:20:1921
3587991591,52cyclictest0-21swapper/2822:20:1921
3587991591,52cyclictest0-21swapper/2822:20:1821
358499159137,11cyclictest0-21swapper/2723:13:0320
358499159137,11cyclictest0-21swapper/2723:13:0320
357599159111,38cyclictest9327-21CPU18
357599159111,38cyclictest9327-21CPU18
357299159138,11cyclictest0-21swapper/2200:27:5015
357299159138,11cyclictest0-21swapper/2200:27:5015
357299159129,11cyclictest0-21swapper/2222:57:1815
357299159129,11cyclictest0-21swapper/2222:57:1815
357299159129,11cyclictest0-21swapper/2222:57:1815
35699915956,76cyclictest4911-21CPU11
35699915956,76cyclictest4911-21CPU11
35699915956,76cyclictest4911-21CPU11
3566991598,74cyclictest28748-21inotify_reader23:35:199
3566991598,74cyclictest28748-21inotify_reader23:35:199
356599159122,34cyclictest0-21swapper/1600:12:368
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional