You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-07-27 - 04:08
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of all highest latencies:
System rackdslot1.osadl.org (updated Fri Jul 26, 2024 12:46:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1659421800,9sleep015876-21/usr/sbin/munin07:05:220
1176911690,7ptp4l0-21swapper/107:06:421
1176911110,16ptp4l0-21swapper/207:05:012
1176911090,16ptp4l0-21swapper/307:05:033
117691660,2ptp4l0-21swapper/208:45:042
117691660,2ptp4l0-21swapper/208:45:042
1823299651,31cyclictest8146-21/usr/sbin/munin07:55:240
117691650,28ptp4l6127-21cut11:20:132
18235996451,7cyclictest41-21ksoftirqd/311:05:113
1823299646,27cyclictest2532-21cpuspeed07:45:120
1823299640,29cyclictest29285-21/usr/sbin/munin09:50:260
1823299631,27cyclictest32734-21/usr/sbin/munin08:50:270
1823299631,27cyclictest1142-21runrttasks08:10:250
1823299631,25cyclictest13960-21/usr/sbin/munin11:35:220
1823299631,24cyclictest28809-21latency_hist12:10:000
1823299631,23cyclictest0-21swapper/009:25:230
117691630,2ptp4l0-21swapper/208:30:032
18233996226,9cyclictest25-21ksoftirqd/110:40:151
18233996226,8cyclictest25-21ksoftirqd/107:50:161
1823299620,25cyclictest25203-21awk09:40:360
117691620,2ptp4l0-21swapper/208:28:012
1823299611,30cyclictest26885-21/usr/sbin/munin09:45:240
1823299611,26cyclictest21448-21irqstats07:15:220
1823299610,30cyclictest19730-21/usr/sbin/munin08:20:260
1823299610,25cyclictest5944-21latency09:00:250
1823299610,24cyclictest27330-21ntpq10:55:250
117691610,2ptp4l0-21swapper/209:32:422
117691610,2ptp4l0-21swapper/012:26:380
18233996026,9cyclictest25-21ksoftirqd/110:00:311
18233996025,9cyclictest25-21ksoftirqd/111:45:171
18233996025,9cyclictest25-21ksoftirqd/111:10:281
18233996024,10cyclictest25-21ksoftirqd/111:15:291
1823299601,28cyclictest22598-21sensors_temp09:35:310
1823299601,27cyclictest6656-21if_enp4s012:30:180
1823299600,26cyclictest18783-21latency_hist10:40:010
1823299600,26cyclictest1142-21runrttasks08:30:430
1823299600,21cyclictest117691ptp4l11:55:090
18233995925,10cyclictest25-21ksoftirqd/112:05:211
18233995924,9cyclictest25-21ksoftirqd/112:14:591
18233995923,9cyclictest25-21ksoftirqd/107:15:141
18233995922,10cyclictest25-21ksoftirqd/108:50:221
1823299591,32cyclictest15796-21/usr/sbin/munin09:20:330
1823299591,30cyclictest3464-21/usr/sbin/munin11:15:120
1823299590,30cyclictest12892-21ps08:05:270
1823299590,29cyclictest11055-21awk08:00:330
1823299590,29cyclictest10494-21/usr/sbin/munin10:20:180
117691590,5ptp4l12372-21runrttasks11:32:202
117691590,2ptp4l0-21swapper/208:10:252
18235995844,7cyclictest41-21ksoftirqd/309:35:103
18235995831,15cyclictest1142-21runrttasks10:35:133
18233995820,10cyclictest25-21ksoftirqd/109:05:141
1823299583,28cyclictest31566-21/usr/sbin/munin08:45:270
1823299583,28cyclictest31566-21/usr/sbin/munin08:45:260
1823299581,32cyclictest9652-21mailstats12:35:280
1823299581,29cyclictest30518-21awk07:35:170
1823299581,28cyclictest5033-21sed10:10:010
1823299581,28cyclictest5033-21sed10:10:000
1823299581,23cyclictest1014-21hddtemp_smartct10:00:150
117691580,2ptp4l0-21swapper/107:20:271
117691580,13ptp4l0-21swapper/307:21:283
18233995723,9cyclictest25-21ksoftirqd/112:20:191
1823299570,31cyclictest9066-21/usr/sbin/munin09:05:350
1823299570,30cyclictest6338-21sed11:20:150
1823299570,30cyclictest26955-21/usr/sbin/munin08:35:310
1823299570,27cyclictest13627-21expr10:25:360
117691570,2ptp4l0-21swapper/309:23:413
117691570,2ptp4l0-21swapper/309:15:523
117691570,2ptp4l0-21swapper/210:15:192
18235995643,6cyclictest41-21ksoftirqd/309:55:103
18233995624,12cyclictest25-21ksoftirqd/111:55:211
18233995624,10cyclictest25-21ksoftirqd/112:15:281
18233995623,9cyclictest25-21ksoftirqd/111:25:221
18233995623,9cyclictest25-21ksoftirqd/111:25:221
1823299561,27cyclictest23130-21cut08:30:000
1823299560,29cyclictest8588-21/usr/sbin/munin10:15:260
1823299560,29cyclictest18246-21/usr/sbin/munin07:10:120
1823299560,28cyclictest1307-21/usr/sbin/munin12:20:250
1823299560,27cyclictest117691ptp4l11:29:360
1823299560,27cyclictest117691ptp4l11:29:350
1823299560,24cyclictest19273-21df09:30:170
117691560,2ptp4l0-21swapper/210:40:282
117691560,2ptp4l0-21swapper/209:59:472
18235995544,5cyclictest41-21ksoftirqd/309:05:123
18235995542,6cyclictest41-21ksoftirqd/307:25:103
18233995524,5cyclictest25-21ksoftirqd/111:20:131
18233995523,9cyclictest25-21ksoftirqd/108:43:091
18233995523,9cyclictest25-21ksoftirqd/108:43:081
18233995522,9cyclictest25-21ksoftirqd/110:55:121
1823299550,29cyclictest31136-21cpu11:05:130
1823299550,27cyclictest28736-21irqstats08:40:200
1823299550,27cyclictest28736-21irqstats08:40:190
117691550,2ptp4l0-21swapper/311:20:293
117691550,2ptp4l0-21swapper/210:23:522
117691550,1ptp4l0-21swapper/209:35:072
97002540,1sleep30-21swapper/311:25:323
97002540,1sleep30-21swapper/311:25:323
1823399547,10cyclictest25-21ksoftirqd/112:40:001
1823299541,24cyclictest120091phc2sys10:10:130
1823299541,22cyclictest0-21swapper/010:30:180
1823299540,24cyclictest25196-21/usr/sbin/munin07:25:310
18235995340,7cyclictest41-21ksoftirqd/311:00:123
18235995340,7cyclictest41-21ksoftirqd/310:15:123
18233995338,3cyclictest25-21ksoftirqd/110:35:301
18233995325,5cyclictest25-21ksoftirqd/109:55:181
18233995317,9cyclictest25-21ksoftirqd/110:45:151
1823299531,28cyclictest5849-21ntp_states07:50:280
1823299531,28cyclictest21346-21cat10:45:100
1823299531,28cyclictest17847-21df_abs11:45:150
1823299531,26cyclictest28500-21/usr/sbin/munin11:00:140
1823299530,28cyclictest15986-21cut11:40:200
1823299530,26cyclictest26021-21date12:00:320
117691530,2ptp4l0-21swapper/211:25:142
117691530,2ptp4l0-21swapper/211:25:142
18235995240,6cyclictest41-21ksoftirqd/310:30:113
18235995239,7cyclictest41-21ksoftirqd/309:30:143
18233995221,9cyclictest25-21ksoftirqd/112:30:001
1823299521,27cyclictest19023-21/usr/sbin/munin10:40:090
1823299521,23cyclictest12941-21meminfo09:15:190
1823299520,31cyclictest3241-21tune2fs08:55:190
1823299520,26cyclictest25317-21sed10:50:320
1823299520,24cyclictest0-21swapper/009:10:260
18235995139,6cyclictest41-21ksoftirqd/307:35:123
1823399517,5cyclictest25-21ksoftirqd/109:15:281
18233995138,4cyclictest25-21ksoftirqd/107:10:151
18233995121,10cyclictest25-21ksoftirqd/108:30:211
18233995115,10cyclictest25-21ksoftirqd/108:10:331
1823399510,8cyclictest0-21swapper/110:50:061
1823299511,29cyclictest23264-21sed07:20:160
117691510,2ptp4l0-21swapper/210:26:262
117691510,1ptp4l0-21swapper/210:04:472
117691510,12ptp4l19552-21fschecks_time10:40:153
1823399504,9cyclictest735-21ps07:40:221
1823399503,10cyclictest25-21ksoftirqd/107:55:261
18233995023,4cyclictest25-21ksoftirqd/108:20:141
117691500,5ptp4l12618-21/usr/sbin/munin08:05:221
117691500,2ptp4l0-21swapper/210:50:102
117691500,1ptp4l0-21swapper/211:15:322
1823399497,4cyclictest25-21ksoftirqd/111:55:011
1823399495,11cyclictest25-21ksoftirqd/108:55:311
1823399494,11cyclictest25-21ksoftirqd/109:40:291
1823399494,11cyclictest25-21ksoftirqd/109:30:241
1823399493,11cyclictest25-21ksoftirqd/109:30:001
1823399493,11cyclictest25-21ksoftirqd/108:00:281
1823399493,10cyclictest25-21ksoftirqd/112:00:281
1823399493,10cyclictest25-21ksoftirqd/110:05:141
1823399493,10cyclictest25-21ksoftirqd/110:05:131
18233994918,10cyclictest25-21ksoftirqd/110:10:201
1823399490,8cyclictest25-21ksoftirqd/108:45:211
1823399490,8cyclictest25-21ksoftirqd/108:45:201
1823299491,28cyclictest18293-21taskset08:19:260
1823299491,26cyclictest29405-21df_abs12:10:150
1823299490,30cyclictest2073-21taskset07:44:080
117691490,1ptp4l0-21swapper/209:48:192
1823599482,3cyclictest41-21ksoftirqd/308:40:173
1823599482,3cyclictest41-21ksoftirqd/308:40:163
1823399488,4cyclictest25-21ksoftirqd/109:50:281
1823399483,9cyclictest25-21ksoftirqd/109:00:211
18233994836,3cyclictest25-21ksoftirqd/108:35:341
1823399482,9cyclictest25-21ksoftirqd/110:15:171
1823399482,9cyclictest17340-21cut08:15:231
1823399480,12cyclictest25-21ksoftirqd/107:25:301
1823299481,26cyclictest31358-21irqstats09:55:190
1823299480,26cyclictest11196-21cat11:30:230
117691480,8ptp4l0-21swapper/211:44:392
117691480,2ptp4l0-21swapper/310:22:573
117691480,1ptp4l0-21swapper/107:33:071
117691480,1ptp4l0-21swapper/107:33:071
117691480,1ptp4l0-21swapper/007:32:190
117691480,1ptp4l0-21swapper/007:32:190
117691480,11ptp4l0-21swapper/308:05:333
117691480,10ptp4l20787-21snmpd08:06:102
1823399472,11cyclictest25-21ksoftirqd/111:05:311
1823399472,10cyclictest25-21ksoftirqd/110:30:141
1823399472,10cyclictest25-21ksoftirqd/107:35:331
1823399471,10cyclictest25-21ksoftirqd/111:40:121
1823399471,10cyclictest25-21ksoftirqd/108:25:151
1823399470,10cyclictest25-21ksoftirqd/109:10:121
117691470,8ptp4l0-21swapper/212:17:402
117691470,8ptp4l0-21swapper/212:09:382
117691470,8ptp4l0-21swapper/209:07:182
117691470,8ptp4l0-21swapper/208:21:332
117691470,8ptp4l0-21swapper/207:57:382
117691470,7ptp4l0-21swapper/212:33:292
117691470,7ptp4l0-21swapper/207:36:062
117691470,2ptp4l0-21swapper/211:35:212
117691470,2ptp4l0-21swapper/210:39:222
117691470,2ptp4l0-21swapper/209:50:492
117691470,1ptp4l0-21swapper/209:12:472
1823399465,5cyclictest25-21ksoftirqd/107:45:211
1823399463,11cyclictest25-21ksoftirqd/109:40:001
18233994626,8cyclictest25-21ksoftirqd/109:45:261
117691460,9ptp4l0-21swapper/211:45:162
117691460,8ptp4l0-21swapper/208:43:362
117691460,8ptp4l0-21swapper/208:43:362
117691460,8ptp4l0-21swapper/208:17:392
117691460,7ptp4l0-21swapper/211:52:062
117691460,1ptp4l0-21swapper/210:59:582
117691460,1ptp4l0-21swapper/209:26:152
55198450,5rtkit-daemon117691ptp4l09:03:552
1823399458,3cyclictest25-21ksoftirqd/110:20:131
1823399453,5cyclictest25-21ksoftirqd/112:30:141
18233994522,9cyclictest25-21ksoftirqd/111:04:101
18233994510,9cyclictest25-21ksoftirqd/111:30:161
1823399450,10cyclictest25-21ksoftirqd/110:25:201
1823299450,28cyclictest0-21swapper/011:12:490
117691450,9ptp4l0-21swapper/207:51:202
117691450,8ptp4l0-21swapper/208:00:482
117691450,8ptp4l0-21swapper/207:29:432
117691450,2ptp4l0-21swapper/309:14:093
117691450,2ptp4l0-21swapper/211:13:272
117691450,1ptp4l0-21swapper/011:52:270
18235994431,7cyclictest41-21ksoftirqd/309:45:113
1823399440,6cyclictest0-21swapper/111:35:191
117691440,7ptp4l0-21swapper/212:02:512
117691440,2ptp4l0-21swapper/310:48:113
117691440,2ptp4l0-21swapper/209:43:382
117691440,1ptp4l0-21swapper/211:01:572
18233994315,10cyclictest25-21ksoftirqd/109:20:161
117691430,5ptp4l1769-21gmain11:59:382
117691430,5ptp4l0-21swapper/208:39:242
117691430,2ptp4l0-21swapper/310:09:513
117691430,2ptp4l0-21swapper/310:09:503
117691430,2ptp4l0-21swapper/210:13:402
117691430,2ptp4l0-21swapper/210:05:252
117691430,2ptp4l0-21swapper/210:05:242
117691430,2ptp4l0-21swapper/207:42:452
117691430,1ptp4l0-21swapper/310:59:323
117691430,1ptp4l0-21swapper/309:27:253
117691430,1ptp4l0-21swapper/211:06:302
117691430,1ptp4l0-21swapper/210:32:462
117691420,5ptp4l951-21/usr/sbin/munin11:10:113
117691420,5ptp4l5289-21hddtemp_smartct07:50:193
117691420,5ptp4l2490-21/usr/sbin/munin12:20:292
117691420,5ptp4l22073-21iostat_ios10:45:192
117691420,4ptp4l3270-21fschecks_time08:55:192
117691420,4ptp4l13070-21memory10:25:233
117691420,2ptp4l0-21swapper/212:37:502
117691420,2ptp4l0-21swapper/212:25:372
117691420,2ptp4l0-21swapper/212:11:262
117691420,2ptp4l0-21swapper/209:20:312
117691420,2ptp4l0-21swapper/209:18:392
117691420,2ptp4l0-21swapper/207:31:562
117691420,2ptp4l0-21swapper/207:31:562
117691420,2ptp4l0-21swapper/207:21:492
117691420,2ptp4l0-21swapper/207:18:072
117691420,2ptp4l0-21swapper/012:15:450
117691410,8ptp4l0-21swapper/308:45:313
117691410,8ptp4l0-21swapper/308:45:303
117691410,4ptp4l23424-21apt-get10:50:043
117691410,4ptp4l20899-21/usr/sbin/munin08:25:323
117691410,2ptp4l0-21swapper/310:00:013
117691410,2ptp4l0-21swapper/308:17:183
117691410,2ptp4l0-21swapper/307:15:313
117691410,2ptp4l0-21swapper/208:50:432
117691410,2ptp4l0-21swapper/207:46:332
117691410,2ptp4l0-21swapper/207:11:012
117691400,5ptp4l5932-21cut10:10:203
117691400,3ptp4l3416-21apt-get11:15:113
117691400,2ptp4l0-21swapper/308:30:313
55198390,2rtkit-daemon0-21swapper/312:15:163
1823599395,5cyclictest41-21ksoftirqd/312:00:283
117691390,4ptp4l24608-21ls09:40:273
117691390,2ptp4l0-21swapper/312:25:273
117691390,2ptp4l0-21swapper/311:43:023
117691390,2ptp4l0-21swapper/308:20:183
117691390,2ptp4l0-21swapper/307:44:253
117691390,2ptp4l0-21swapper/307:11:583
117691380,2ptp4l0-21swapper/312:20:223
117691380,2ptp4l0-21swapper/312:07:383
117691380,2ptp4l0-21swapper/309:50:313
117691380,2ptp4l0-21swapper/307:55:213
1823599373,4cyclictest121rcu_preempt08:35:173
117691370,2ptp4l0-21swapper/311:55:093
117691370,2ptp4l0-21swapper/311:30:193
1823599365,4cyclictest41-21ksoftirqd/308:50:293
117691360,2ptp4l0-21swapper/312:37:353
117691360,2ptp4l0-21swapper/311:37:283
117691360,2ptp4l0-21swapper/308:04:503
117691360,1ptp4l0-21swapper/307:46:443
18235993528,4cyclictest41-21ksoftirqd/311:50:013
117691350,2ptp4l0-21swapper/309:02:303
18235993427,4cyclictest41-21ksoftirqd/308:55:343
18235993317,5cyclictest41-21ksoftirqd/307:30:113
18235993317,5cyclictest41-21ksoftirqd/307:30:113
18235993125,4cyclictest41-21ksoftirqd/312:30:163
18235993125,3cyclictest41-21ksoftirqd/312:10:273
18235993024,3cyclictest41-21ksoftirqd/311:45:143
18235993024,3cyclictest41-21ksoftirqd/308:10:373
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional