You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-04-20 - 10:15
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackbslot4.osadl.org (updated Sat Apr 20, 2024 00:43:35)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
24127996316,41cyclictest24140-21/usr/sbin/munin19:37:182
24127996312,44cyclictest32414-21kworker/2:123:15:152
2412799626,50cyclictest0-21swapper/223:20:422
24127996213,43cyclictest7358-21ls21:02:142
2371826214,18sleep10-21swapper/118:10:031
24127996117,38cyclictest20006-21/usr/sbin/munin21:22:032
24127996116,38cyclictest19341-21iostat_ios20:32:122
24127996019,12cyclictest16643-21grep20:27:262
24127996015,39cyclictest21293-21latency_hist22:11:522
24127996014,40cyclictest13328-21/usr/sbin/munin21:12:212
24127996014,40cyclictest11025-21/usr/sbin/munin19:02:102
24127996011,43cyclictest27003-21ssh20:42:262
24127995918,35cyclictest28656-21aten_rbpower_vo22:22:022
24127995916,37cyclictest26010-21/usr/sbin/munin19:42:092
24127995915,38cyclictest27806-21iostat_ios23:07:082
24127995913,41cyclictest667-21runrttasks19:52:292
24127995912,41cyclictest18867-21ssh22:53:252
24127995912,12cyclictest1682-21/usr/sbin/munin18:37:292
2412799589,44cyclictest1409-21fschecks_time20:02:092
2412799584,31cyclictest0-21swapper/220:07:462
24127995818,34cyclictest4581-21/usr/sbin/munin21:47:252
24127995816,36cyclictest0-21swapper/221:33:402
24127995816,10cyclictest0-21swapper/220:23:572
24127995815,37cyclictest20395-21/usr/sbin/munin19:27:162
24127995815,36cyclictest26595-21/usr/sbin/munin18:17:202
24127995814,39cyclictest10029-21/usr/sbin/munin21:07:202
24127995814,39cyclictest10029-21/usr/sbin/munin21:07:202
24127995814,38cyclictest9797-21ssh21:53:462
24127995814,38cyclictest27879-21/usr/sbin/munin19:47:232
24127995813,40cyclictest667-21runrttasks23:05:042
24127995813,39cyclictest28462-21/usr/sbin/munin18:22:082
24127995813,39cyclictest23617-21ssh23:01:262
24127995810,41cyclictest0-21swapper/222:12:162
2413299574,46cyclictest0-21swapper/320:23:553
2412799575,46cyclictest0-21swapper/222:47:522
24127995718,34cyclictest32414-21kworker/2:121:57:442
24127995715,37cyclictest24342-21snmpd19:07:252
24127995715,36cyclictest9165-21/usr/sbin/munin18:57:322
24127995715,36cyclictest9165-21/usr/sbin/munin18:57:322
24127995715,36cyclictest16651-21/usr/sbin/munin19:17:222
24127995715,10cyclictest0-21swapper/220:41:462
24127995714,37cyclictest5419-21/usr/sbin/munin18:47:232
24127995714,37cyclictest32204-21/usr/sbin/munin18:32:152
24127995714,37cyclictest32112-21iostat_ios19:57:132
24127995713,39cyclictest682-21sshd18:55:482
24127995713,38cyclictest18523-21/usr/sbin/munin19:22:122
24127995712,39cyclictest29294-21df20:47:082
24127995712,39cyclictest14804-21aten_rbpower_cu19:12:042
2413299564,46cyclictest0-21swapper/321:47:033
24127995615,35cyclictest31614-21chrt18:27:332
24127995614,36cyclictest17341-21memory21:17:152
24127995614,36cyclictest0-21swapper/221:30:172
24127995613,37cyclictest9836-21ssh23:29:482
24127995613,37cyclictest9836-21ssh23:29:482
24127995613,37cyclictest3555-21/usr/sbin/munin18:42:112
24127995611,39cyclictest0-21swapper/220:18:212
24127995611,39cyclictest0-21swapper/220:18:212
2412199564,45cyclictest0-21swapper/122:42:251
2412799554,46cyclictest0-21swapper/223:22:112
2412799554,45cyclictest0-21swapper/220:12:452
24127995516,34cyclictest7451-21ntp_kernel_pll_22:37:162
24127995516,34cyclictest26093-21sshd18:13:332
24127995515,34cyclictest22262-21/usr/sbin/munin19:32:222
24127995514,36cyclictest4516-21users22:32:262
24127995513,37cyclictest32051-21ssh21:38:352
24127995513,37cyclictest16350-21ssh22:03:162
24127995513,36cyclictest13471-21ssh23:35:482
24127995513,36cyclictest0-21swapper/220:57:532
24127995512,37cyclictest1349-21ssh20:52:262
2413299544,44cyclictest0-21swapper/322:41:483
2412799549,39cyclictest0-21swapper/223:37:052
24127995415,13cyclictest32219-21df_inode22:27:052
24127995413,35cyclictest10064-21ssh22:41:542
24127995413,10cyclictest0-21swapper/222:16:532
24127995313,34cyclictest1188-21/usr/sbin/munin21:42:182
2413299524,42cyclictest0-21swapper/320:42:563
2413299523,44cyclictest0-21swapper/321:26:543
2413299522,44cyclictest26657-21ssh22:17:523
2413299514,41cyclictest0-21swapper/322:24:523
2413299513,8cyclictest0-21swapper/321:08:143
2413299513,8cyclictest0-21swapper/321:08:143
2413299513,42cyclictest0-21swapper/323:29:013
2413299513,42cyclictest0-21swapper/323:29:013
2413299512,7cyclictest980-21munin-run23:16:513
2411799513,43cyclictest0-21swapper/022:02:330
2413299504,41cyclictest0-21swapper/320:14:553
2413299504,40cyclictest0-21swapper/322:12:323
2413299504,40cyclictest0-21swapper/321:52:173
2413299502,42cyclictest13078-21kworker/3:121:34:333
24132995011,33cyclictest0-21swapper/322:49:153
24121995019,26cyclictest14698-21uname23:37:141
2413299495,38cyclictest0-21swapper/320:32:173
2413299494,40cyclictest0-21swapper/323:34:213
2413299494,39cyclictest0-21swapper/323:00:133
2413299494,39cyclictest0-21swapper/320:55:163
2413299493,8cyclictest0-21swapper/321:40:333
2413299493,41cyclictest3879-21ssh23:21:013
24132994912,5cyclictest10792-21missed_timers22:42:113
24132994911,33cyclictest14698-21aten_rbpower_vo22:02:033
2412199494,39cyclictest0-21swapper/121:37:081
2413299484,39cyclictest0-21swapper/321:17:113
2413299484,39cyclictest0-21swapper/320:48:553
2413299484,38cyclictest0-21swapper/323:23:363
2413299483,9cyclictest0-21swapper/321:03:343
2413299483,40cyclictest0-21swapper/321:12:143
24132994813,30cyclictest25399-21sshd21:29:053
2412199484,38cyclictest0-21swapper/121:59:541
2412199483,8cyclictest0-21swapper/120:31:051
2413299476,14cyclictest0-21swapper/322:33:213
2413299475,36cyclictest0-21swapper/320:37:043
2413299475,36cyclictest0-21swapper/320:28:163
2413299475,13cyclictest0-21swapper/323:07:013
2413299474,37cyclictest0-21swapper/322:29:153
2413299474,37cyclictest0-21swapper/322:09:123
2413299474,37cyclictest0-21swapper/321:44:593
2413299474,37cyclictest0-21swapper/320:58:453
2412199478,7cyclictest0-21swapper/122:30:181
2412199474,37cyclictest0-21swapper/122:32:411
2412199474,37cyclictest0-21swapper/122:01:541
2412199474,36cyclictest0-21swapper/122:51:371
2411799474,37cyclictest0-21swapper/021:57:220
236262478,33sleep20-21swapper/218:08:552
2413299466,35cyclictest0-21swapper/323:37:383
2413299464,36cyclictest0-21swapper/323:01:553
2413299464,36cyclictest0-21swapper/320:17:543
2413299464,36cyclictest0-21swapper/320:17:543
2413299464,16cyclictest0-21swapper/321:58:213
2413299463,38cyclictest0-21swapper/322:52:573
2412199465,35cyclictest0-21swapper/122:37:291
2412199464,36cyclictest0-21swapper/122:57:181
2412199464,36cyclictest0-21swapper/121:36:241
2412199464,36cyclictest0-21swapper/121:12:331
2411799465,35cyclictest0-21swapper/022:32:190
2411799463,37cyclictest0-21swapper/023:07:200
142542463,7sleep00-21swapper/023:37:050
2412199455,34cyclictest0-21swapper/120:39:591
2412199454,36cyclictest0-21swapper/121:08:451
2412199454,36cyclictest0-21swapper/121:08:451
2412199454,35cyclictest0-21swapper/120:52:151
2412199454,35cyclictest0-21swapper/120:47:561
2412199454,35cyclictest0-21swapper/120:17:261
2412199454,35cyclictest0-21swapper/120:17:261
2412199453,36cyclictest10244-21chrt23:30:531
2412199453,36cyclictest10244-21chrt23:30:531
2412199453,36cyclictest0-21swapper/121:05:311
2412199453,36cyclictest0-21swapper/120:25:561
2412199452,35cyclictest31373-21/usr/sbin/munin23:12:181
236932458,13sleep30-21swapper/318:09:453
225062453,7sleep00-21swapper/022:58:450
52202443,8sleep00-21swapper/020:58:390
277912443,7sleep00-21swapper/020:44:100
2412199445,33cyclictest0-21swapper/121:43:011
2412199444,7cyclictest0-21swapper/122:17:301
2412199444,34cyclictest0-21swapper/122:07:251
2412199443,36cyclictest0-21swapper/121:22:241
2412199443,35cyclictest0-21swapper/123:32:051
2412199443,35cyclictest0-21swapper/118:12:101
2411799444,35cyclictest0-21swapper/023:32:540
2411799444,34cyclictest0-21swapper/023:02:130
2411799443,36cyclictest0-21swapper/020:37:160
273952433,7sleep00-21swapper/022:19:410
2412199438,29cyclictest0-21swapper/121:31:441
2412199434,33cyclictest0-21swapper/123:04:351
2412199434,33cyclictest0-21swapper/122:23:481
2412199433,35cyclictest0-21swapper/120:12:271
2412199433,34cyclictest4123-21sed20:57:181
2411799434,7cyclictest0-21swapper/021:42:320
2411799434,16cyclictest0-21swapper/020:27:200
2411799433,35cyclictest0-21swapper/021:37:230
230252433,7sleep10-21swapper/122:12:341
106982433,8sleep00-21swapper/020:19:510
106982433,8sleep00-21swapper/020:19:510
2412199424,33cyclictest0-21swapper/122:52:321
2412199423,34cyclictest0-21swapper/121:52:351
117772423,8sleep00-21swapper/020:22:000
10972423,7sleep00-21swapper/018:32:350
311582413,8sleep10-21swapper/119:54:051
284332413,7sleep10-21swapper/120:45:521
2413299413,32cyclictest25644-21smart_sda18:12:273
24121994127,9cyclictest0-21swapper/121:47:331
64122403,8sleep00-21swapper/021:48:380
194302403,7sleep00-21swapper/022:54:470
101942403,7sleep10-21swapper/118:57:351
101942403,7sleep10-21swapper/118:57:351
61812393,6sleep30-21swapper/318:47:233
319192393,30sleep00-21swapper/020:51:100
28042393,7sleep00-21swapper/023:17:570
279682393,6sleep30-21swapper/318:18:383
279662393,7sleep10-21swapper/118:18:361
26262393,7sleep00-21swapper/020:05:180
261022393,7sleep00-21swapper/018:13:400
254832393,7sleep10-21swapper/119:38:191
2379523915,18sleep00-21swapper/018:10:580
236582393,7sleep00-21swapper/019:33:520
157392393,7sleep00-21swapper/021:15:090
114032393,7sleep00-21swapper/021:07:280
114032393,7sleep00-21swapper/021:07:280
72822383,7sleep00-21swapper/020:15:000
48702383,7sleep00-21swapper/018:43:010
243552383,7sleep00-21swapper/022:15:470
2411799384,28cyclictest0-21swapper/021:32:290
24117993827,7cyclictest1418-21head20:52:260
24117993826,7cyclictest13282-21cut19:07:170
219992383,7sleep00-21swapper/019:31:260
155672383,8sleep00-21swapper/022:48:550
142632383,7sleep10-21swapper/119:08:211
68192373,7sleep00-21swapper/018:48:570
312012373,6sleep30-21swapper/319:54:353
2412199374,28cyclictest0-21swapper/120:02:271
2411799374,29cyclictest0-21swapper/022:28:290
24117993716,7cyclictest126362ssh22:45:190
162292373,7sleep10-21swapper/119:14:291
24121993624,7cyclictest31641-21cut19:57:051
2411799365,26cyclictest0-21swapper/019:47:290
2411799364,28cyclictest0-21swapper/021:31:400
2411799363,28cyclictest0-21swapper/022:22:170
24117993623,8cyclictest6647-21cut22:37:020
107702363,7sleep00-21swapper/021:56:190
50542353,6sleep30-21swapper/318:45:143
32082353,7sleep10-21swapper/118:40:291
298272353,6sleep30-21swapper/318:23:333
245972353,6sleep30-21swapper/319:37:123
24132993523,7cyclictest10669-21awk19:00:183
24132993523,7cyclictest10669-21awk19:00:183
2412199354,26cyclictest0-21swapper/118:45:471
2411799354,26cyclictest0-21swapper/018:58:280
2411799354,26cyclictest0-21swapper/018:58:280
2411799353,27cyclictest0-21swapper/023:29:300
2411799353,27cyclictest0-21swapper/023:29:300
24117993523,7cyclictest26393-21tune2fs19:42:090
193102353,7sleep10-21swapper/121:20:461
149442352,28sleep014953-21diskstats19:12:070
144402353,6sleep30-21swapper/319:10:293
2412199344,24cyclictest0-21swapper/118:32:131
24121993425,5cyclictest21-21ksoftirqd/118:26:581
24121993422,7cyclictest7840-21wc18:52:201
2411799344,26cyclictest0-21swapper/021:22:000
2411799344,26cyclictest0-21swapper/020:34:290
2411799344,25cyclictest0-21swapper/023:23:480
24117993423,6cyclictest8277-21bash21:02:540
24117993422,7cyclictest8210-21smart_sda18:52:300
318302334,7sleep00-21swapper/023:12:300
276262333,7sleep10-21swapper/119:46:321
2412199334,24cyclictest0-21swapper/118:50:331
24121993321,7cyclictest20662-21ssh20:33:381
2411799334,25cyclictest0-21swapper/022:09:150
24117993320,8cyclictest378-21systemd-journal18:41:570
189942333,7sleep00-21swapper/021:19:560
24132993217,10cyclictest30422-21cut18:27:083
24121993222,6cyclictest23965-21latency_hist19:36:561
2411799324,24cyclictest0-21swapper/019:22:590
2411799323,26cyclictest0-21swapper/019:03:280
2411799323,25cyclictest0-21swapper/018:26:590
2411799323,25cyclictest0-21swapper/018:23:290
24117993222,6cyclictest3547-21latency20:07:170
2412199314,22cyclictest0-21swapper/123:21:581
2412199313,24cyclictest0-21swapper/120:07:221
24117993120,6cyclictest27074-21interrupts18:17:150
2413299304,21cyclictest0-21swapper/318:32:093
2413299303,22cyclictest0-21swapper/319:02:283
24132993019,7cyclictest2854-21grep18:37:313
24132993018,8cyclictest16935-21cut19:17:093
24121993019,7cyclictest1258-21/usr/sbin/munin23:17:111
24121993017,8cyclictest27615-21cut23:07:051
2411799304,21cyclictest0-21swapper/019:57:040
2411799304,21cyclictest0-21swapper/019:52:250
2411799304,21cyclictest0-21swapper/019:41:550
2413299294,20cyclictest0-21swapper/319:22:223
2413299294,19cyclictest0-21swapper/319:47:203
2413299293,22cyclictest0-21swapper/319:43:473
24132992919,6cyclictest14942-21df19:12:063
2412199294,20cyclictest0-21swapper/119:22:071
2412199293,21cyclictest0-21swapper/119:47:071
2412199293,21cyclictest0-21swapper/119:27:131
24121992918,7cyclictest17678-21timerandwakeup19:17:241
2411799293,21cyclictest16824-21diskstats19:17:080
2413299286,18cyclictest0-21swapper/319:32:073
2413299284,18cyclictest0-21swapper/319:27:083
2412199282,21cyclictest29194-21tr18:22:171
24121992815,8cyclictest11134-21tr19:02:061
2413299275,17cyclictest0-21swapper/318:52:133
2413299273,20cyclictest3811-21wc20:07:253
24132992714,8cyclictest2764-21crond20:06:553
24132992515,6cyclictest667-21runrttasks19:57:413
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional