You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-03-25 - 22:26
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rackdslot1.osadl.org (updated Tue Mar 25, 2025 12:45:44)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2847191710,18ptp4l0-21swapper/309:53:093
2847191680,4ptp4l14668-21apt-get07:20:113
2847191650,4ptp4l9466-21memory12:15:212
10003996213,11cyclictest8482-21taskset12:15:050
10003996212,17cyclictest4022-21tail12:00:240
10003996212,17cyclictest4022-21tail12:00:240
10003996210,13cyclictest8175-21latency_hist12:15:000
2847191610,5ptp4l0-21swapper/307:15:123
2847191600,4ptp4l0-21swapper/309:29:343
2847191600,4ptp4l0-21swapper/308:40:003
2847191600,4ptp4l0-21swapper/007:15:270
2847191590,4ptp4l0-21swapper/307:05:033
2847191580,4ptp4l0-21swapper/310:47:003
2847191580,4ptp4l0-21swapper/210:26:522
2847191580,4ptp4l0-21swapper/210:13:052
2847191580,3ptp4l0-21swapper/108:45:241
1000499588,17cyclictest21130-21chrt07:32:281
10003995814,11cyclictest7961-21taskset09:23:010
10003995813,17cyclictest477-21ls11:55:120
10003995813,11cyclictest9466-21seq10:52:410
10003995813,10cyclictest1299-21runrttasks09:17:340
2847191570,3ptp4l0-21swapper/210:49:352
2847191570,3ptp4l0-21swapper/207:33:482
1000499579,16cyclictest32749-21chrt07:57:271
1000499577,11cyclictest28457-21chrt08:57:531
10003995713,11cyclictest26141-21seq08:53:270
10003995712,11cyclictest26541-21seq10:14:210
10003995712,11cyclictest1299-21runrttasks11:05:440
1000499569,16cyclictest4841-21chrt12:04:151
1000499569,16cyclictest4841-21chrt12:04:151
1000499568,16cyclictest13024-21chrt09:35:441
10003995614,11cyclictest1299-21runrttasks09:09:430
10003995614,11cyclictest1299-21runrttasks09:09:430
10003995614,11cyclictest1299-21runrttasks08:24:060
10003995613,11cyclictest7023-21seq10:45:550
10003995613,11cyclictest32680-21seq07:56:340
10003995612,11cyclictest23943-21seq10:05:350
2847191550,4ptp4l0-21swapper/312:32:383
2847191550,4ptp4l0-21swapper/311:27:033
2847191550,4ptp4l0-21swapper/308:25:003
2847191550,4ptp4l0-21swapper/211:28:472
2847191550,3ptp4l0-21swapper/211:05:202
1000499559,15cyclictest21060-21chrt09:59:151
1000499558,16cyclictest18752-21chrt09:54:131
1000499558,15cyclictest25823-21chrt07:43:111
1000499555,11cyclictest242012chrt08:50:111
10003995516,10cyclictest22445-21/usr/sbin/munin07:35:220
10003995514,10cyclictest1299-21runrttasks09:34:510
10003995513,11cyclictest1299-21runrttasks09:29:010
10003995513,11cyclictest1299-21runrttasks08:41:470
10003995512,12cyclictest1299-21runrttasks11:13:470
10003995512,11cyclictest1299-21runrttasks11:26:140
2847191540,4ptp4l0-21swapper/212:12:542
2847191540,4ptp4l0-21swapper/210:33:392
2847191540,4ptp4l0-21swapper/210:33:392
1000499548,16cyclictest7267-21chrt10:49:061
1000499548,16cyclictest13263-21chrt12:26:461
1000499548,15cyclictest32100-21chrt11:51:121
1000499547,16cyclictest12585-21chrt12:21:001
10003995413,10cyclictest26763-21seq11:35:530
2847191530,5ptp4l0-21swapper/207:58:202
1000499538,15cyclictest28713-21chrt10:16:521
1000499536,11cyclictest14783-21chrt11:08:231
1000499536,10cyclictest215582chrt08:43:531
1000399539,11cyclictest18794-21grep08:35:270
10003995315,15cyclictest5510-21taskset12:09:530
10003995315,11cyclictest29180-21taskset11:41:170
10003995315,10cyclictest6484-21taskset10:41:590
10003995312,11cyclictest13186-21seq09:37:520
10003995310,11cyclictest0-21swapper/008:10:150
2847191520,4ptp4l0-21swapper/310:01:163
2847191520,4ptp4l0-21swapper/208:14:532
2847191520,4ptp4l0-21swapper/207:12:232
2847191520,3ptp4l0-21swapper/312:39:143
1000499529,11cyclictest15706-21chrt12:33:321
1000499528,11cyclictest26356-21chrt10:11:591
1000499527,15cyclictest5473-21chrt08:10:031
1000499527,11cyclictest31888-21chrt10:26:591
1000499526,12cyclictest1299-21runrttasks10:42:431
1000499526,10cyclictest14063-21chrt11:02:091
10003995212,10cyclictest1905-21seq10:32:510
10003995212,10cyclictest1905-21seq10:32:510
10003995211,10cyclictest19782-21/usr/sbin/munin11:20:280
2847191510,5ptp4l0-21swapper/311:09:513
2847191510,4ptp4l0-21swapper/312:24:363
2847191510,4ptp4l0-21swapper/310:52:093
2847191510,4ptp4l0-21swapper/211:40:172
2847191510,4ptp4l0-21swapper/210:54:512
2847191510,4ptp4l0-21swapper/007:07:320
1000499517,16cyclictest30524-21chrt07:53:301
1000499517,12cyclictest733-21chrt09:08:361
1000499517,12cyclictest733-21chrt09:08:361
1000499516,11cyclictest1299-21runrttasks09:25:121
1000499514,12cyclictest41812sleep110:37:181
1000499514,11cyclictest194062chrt11:18:301
10003995114,11cyclictest28826-21taskset10:18:180
2847191500,4ptp4l0-21swapper/309:16:503
2847191500,4ptp4l0-21swapper/212:01:162
2847191500,4ptp4l0-21swapper/212:01:162
2847191500,3ptp4l0-21swapper/311:19:413
2847191500,3ptp4l0-21swapper/308:19:303
1000499507,12cyclictest15513-21seq09:42:531
1000499507,10cyclictest14232-21chrt07:18:001
1000499506,10cyclictest1299-21runrttasks10:31:551
1000499506,10cyclictest1299-21runrttasks10:31:551
10003995015,31cyclictest19284-21df09:55:140
10003995014,32cyclictest22191-21/usr/sbin/munin10:00:190
2847191490,4ptp4l0-21swapper/311:44:243
2847191490,4ptp4l0-21swapper/308:32:063
2847191490,3ptp4l0-21swapper/309:12:393
2847191490,3ptp4l0-21swapper/309:12:393
1000499498,16cyclictest16198-21chrt09:45:591
10003994913,11cyclictest0-21swapper/012:37:520
10003994911,16cyclictest0-21swapper/012:27:130
2847191480,4ptp4l0-21swapper/311:50:573
2847191480,3ptp4l0-21swapper/307:48:253
2847191480,3ptp4l0-21swapper/209:35:452
2847191480,3ptp4l0-21swapper/111:25:351
1000499488,16cyclictest2216-21chrt11:55:331
1000499487,10cyclictest11813-21taskset10:58:081
1000399489,10cyclictest0-21swapper/009:46:350
1000399488,10cyclictest10998-21chrt07:10:210
10003994813,15cyclictest1299-21runrttasks07:34:170
10003994810,17cyclictest0-21swapper/012:21:560
10003994810,17cyclictest0-21swapper/008:00:070
2847191470,4ptp4l0-21swapper/308:13:183
2847191470,3ptp4l0-21swapper/310:15:293
2847191470,3ptp4l0-21swapper/107:36:241
1000499478,15cyclictest29391-21chrt11:44:021
1000499478,11cyclictest28176-21chrt07:48:051
1000499477,7cyclictest0-21swapper/111:10:131
1000499477,15cyclictest21526-21taskset11:20:511
1000499476,10cyclictest11937-21taskset07:13:101
1000499473,10cyclictest1299-21runrttasks09:22:151
1000499472,11cyclictest17493-21sed12:35:311
1000399478,11cyclictest15246-21awk09:40:290
10003994712,12cyclictest16526-21taskset07:22:350
10003994710,16cyclictest0-21swapper/011:46:440
10003994710,16cyclictest0-21swapper/008:31:120
10003994710,11cyclictest0-21swapper/011:53:090
1000399470,11cyclictest0-21swapper/009:10:560
1000399470,11cyclictest0-21swapper/009:10:560
2847191460,4ptp4l19603-21apt-get08:40:133
2847191460,4ptp4l0-21swapper/208:20:422
2847191460,4ptp4l0-21swapper/207:35:442
1000499468,11cyclictest30855-21chrt09:03:431
1000499467,11cyclictest5071-21taskset08:07:501
1000499466,11cyclictest1299-21runrttasks11:32:131
10003994612,7cyclictest2847191ptp4l08:29:220
2847191450,7ptp4l8236-21iostat07:05:182
2847191450,4ptp4l0-21swapper/311:22:133
2847191450,4ptp4l0-21swapper/211:56:352
1000499457,11cyclictest2705-21taskset08:02:051
1000499456,10cyclictest18769-21chrt07:26:461
1000499456,10cyclictest1299-21runrttasks08:35:421
10003994512,9cyclictest0-21swapper/011:04:050
10003994511,31cyclictest0-21swapper/008:45:210
2847191440,9ptp4l0-21swapper/211:13:382
2847191440,9ptp4l0-21swapper/210:37:272
2847191440,9ptp4l0-21swapper/207:19:062
2847191440,5ptp4l8620-21meminfo07:05:191
2847191440,5ptp4l101ktimersoftd/007:40:470
2847191440,4ptp4l0-21swapper/309:42:133
2847191440,4ptp4l0-21swapper/212:34:272
2847191440,4ptp4l0-21swapper/212:29:132
2847191440,3ptp4l0-21swapper/211:32:562
2847191440,3ptp4l0-21swapper/210:40:562
2847191440,3ptp4l0-21swapper/208:48:052
2847191440,11ptp4l0-21swapper/209:05:152
2847191440,11ptp4l0-21swapper/209:05:152
1000499448,15cyclictest3152-21chrt09:11:171
1000499448,15cyclictest3152-21chrt09:11:171
1000499447,11cyclictest16735-21chrt08:34:101
1000499446,10cyclictest31265-21chrt10:21:581
10003994417,16cyclictest5012-21seq08:07:050
2847191430,9ptp4l0-21swapper/008:15:300
2847191430,5ptp4l24116-21/usr/sbin/munin07:40:153
2847191430,5ptp4l0-21swapper/209:00:182
2847191430,4ptp4l26230-21apt-get07:45:172
2847191430,4ptp4l19070-21apt-get09:55:122
2847191430,4ptp4l16976-21apt-get07:25:133
2847191430,4ptp4l15686-21apt-get09:45:023
2847191430,4ptp4l0-21swapper/312:09:443
2847191430,4ptp4l0-21swapper/210:18:462
2847191430,4ptp4l0-21swapper/208:00:152
1000499435,11cyclictest5425-21runrttasks12:08:481
10003994317,15cyclictest18648-21seq09:52:520
10003994316,16cyclictest15759-21seq12:34:140
10003994316,15cyclictest24518-21seq11:31:400
10003994316,15cyclictest11742-21taskset10:57:120
10003994316,12cyclictest31155-21seq10:20:320
10003994311,6cyclictest2847191ptp4l11:17:490
1000399430,11cyclictest0-21swapper/009:04:260
2847191420,5ptp4l0-21swapper/311:10:193
2847191420,5ptp4l0-21swapper/212:35:142
2847191420,5ptp4l0-21swapper/210:20:192
2847191420,4ptp4l7425-21python09:20:263
2847191420,4ptp4l7201-21ntp_states09:20:242
2847191420,4ptp4l28981-21apt-get10:20:013
2847191420,4ptp4l19284-21apt-get07:30:153
2847191420,4ptp4l0-21swapper/311:37:393
2847191420,4ptp4l0-21swapper/309:31:533
2847191420,4ptp4l0-21swapper/307:59:363
2847191420,4ptp4l0-21swapper/209:53:132
2847191420,4ptp4l0-21swapper/209:10:092
2847191420,4ptp4l0-21swapper/209:10:092
2847191420,4ptp4l0-21swapper/208:35:222
2847191420,4ptp4l0-21swapper/207:44:332
2847191420,3ptp4l1314-21sshd09:43:162
2847191420,3ptp4l12454-21apt-get08:25:142
2847191420,3ptp4l10983-21ls07:10:193
1000499428,16cyclictest29852-21chrt11:46:581
1000399429,22cyclictest0-21swapper/007:54:500
10003994217,15cyclictest31798-21seq10:25:500
10003994216,16cyclictest28511-21seq08:58:320
10003994216,16cyclictest2311-21taskset10:35:020
10003994216,15cyclictest28179-21seq07:48:080
2847191410,6ptp4l22794-21grep10:00:252
2847191410,5ptp4l3420-21sed08:05:152
2847191410,5ptp4l0-21swapper/312:10:043
2847191410,5ptp4l0-21swapper/309:05:223
2847191410,5ptp4l0-21swapper/309:05:223
2847191410,4ptp4l32370-21apt-get10:30:083
2847191410,4ptp4l32370-21apt-get10:30:083
2847191410,4ptp4l20562-21meminfo08:40:212
2847191410,4ptp4l0-21swapper/310:35:153
2847191410,4ptp4l0-21swapper/308:47:323
2847191410,4ptp4l0-21swapper/308:29:363
2847191410,4ptp4l0-21swapper/308:05:123
2847191410,4ptp4l0-21swapper/308:00:313
2847191410,4ptp4l0-21swapper/209:15:082
2847191410,4ptp4l0-21swapper/110:00:171
2847191410,3ptp4l9902-21apt-get10:55:133
2847191410,3ptp4l24533-21apt-get10:10:083
2847191410,3ptp4l22553-21memory07:35:243
2847191410,3ptp4l1778-21gnome-shell11:58:593
2847191410,3ptp4l0-21swapper/308:57:073
2847191410,3ptp4l0-21swapper/209:49:082
2847191410,2ptp4l0-21swapper/308:50:313
1000499418,15cyclictest7837-21chrt12:12:261
1000499417,15cyclictest9321-21taskset10:50:501
2847191400,5ptp4l0-21swapper/309:39:143
2847191400,4ptp4l16962-21/usr/sbin/munin07:25:162
2847191400,4ptp4l0-21swapper/312:16:553
2847191400,4ptp4l0-21swapper/312:00:303
2847191400,4ptp4l0-21swapper/312:00:303
2847191400,4ptp4l0-21swapper/310:40:253
2847191400,4ptp4l0-21swapper/307:50:223
2847191400,4ptp4l0-21swapper/211:51:042
2847191400,4ptp4l0-21swapper/209:30:592
2847191400,4ptp4l0-21swapper/209:25:022
2847191400,4ptp4l0-21swapper/208:57:502
2847191400,4ptp4l0-21swapper/208:32:562
2847191400,4ptp4l0-21swapper/208:18:522
2847191400,4ptp4l0-21swapper/207:54:242
2847191400,4ptp4l0-21swapper/207:20:122
2847191400,4ptp4l0-21swapper/108:26:041
2847191400,4ptp4l0-21swapper/007:27:590
2847191400,3ptp4l25342-21ntp_states08:50:242
2847191400,3ptp4l0-21swapper/310:06:443
2847191390,4ptp4l17454-21/usr/sbin/munin11:15:252
2847191390,4ptp4l0-21swapper/312:25:403
2847191390,4ptp4l0-21swapper/311:46:583
2847191390,4ptp4l0-21swapper/311:30:103
2847191390,4ptp4l0-21swapper/311:01:193
2847191390,4ptp4l0-21swapper/310:29:093
2847191390,4ptp4l0-21swapper/309:56:163
2847191390,4ptp4l0-21swapper/309:00:043
2847191390,4ptp4l0-21swapper/212:24:512
2847191390,4ptp4l0-21swapper/211:46:182
2847191390,4ptp4l0-21swapper/211:36:272
2847191390,4ptp4l0-21swapper/211:03:122
2847191390,4ptp4l0-21swapper/210:55:202
2847191390,4ptp4l0-21swapper/210:05:162
2847191390,4ptp4l0-21swapper/110:06:521
2847191390,4ptp4l0-21swapper/109:31:551
2847191390,4ptp4l0-21swapper/108:20:231
2847191390,3ptp4l0-21swapper/109:17:141
2847191390,3ptp4l0-21swapper/108:15:061
1000499393,11cyclictest0-21swapper/111:35:251
2847191380,4ptp4l0-21swapper/212:08:212
2847191380,4ptp4l0-21swapper/211:21:302
2847191380,3ptp4l0-21swapper/107:20:181
1000499367,10cyclictest10253-21chrt12:15:591
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional