You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-04-28 - 08:02
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackbslot4.osadl.org (updated Sun Apr 28, 2024 00:43:35)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
11296995818,35cyclictest29-21ksoftirqd/220:52:362
1128399584,49cyclictest0-21swapper/020:23:080
1128399584,47cyclictest0-21swapper/023:04:440
1128399583,48cyclictest0-21swapper/023:17:440
1130399554,45cyclictest0-21swapper/322:48:243
1129699554,44cyclictest0-21swapper/220:30:492
1128399554,7cyclictest0-21swapper/022:23:250
11303995418,31cyclictest306302sleep319:03:003
1129699542,7cyclictest29177-21ssh22:29:152
11287995418,30cyclictest12967-21ls18:08:081
1128399544,18cyclictest0-21swapper/020:52:210
1128399542,46cyclictest16310-21ssh22:57:040
1129699534,42cyclictest0-21swapper/220:55:172
11296995318,29cyclictest29-21ksoftirqd/221:18:122
11296995315,32cyclictest21439-21sshd21:34:342
11287995321,26cyclictest16022-21tune2fs18:17:561
11287995316,31cyclictest1867-21ssh23:22:421
11287995313,7cyclictest31130-21needreboot21:47:591
1128399535,41cyclictest0-21swapper/021:10:070
1128399532,19cyclictest5976-21ssh20:28:460
1129699525,41cyclictest0-21swapper/223:27:442
1129699524,42cyclictest0-21swapper/221:52:532
1129699524,41cyclictest0-21swapper/222:01:252
11296995213,34cyclictest4910-21latency_hist19:22:402
11287995222,25cyclictest9688-21missed_timers22:02:571
11287995222,24cyclictest27312-21wc18:53:211
11287995219,28cyclictest27318-21irqstats21:43:011
11287995215,31cyclictest29093-21date18:58:141
1128399524,9cyclictest0-21swapper/021:28:260
1128399524,9cyclictest0-21swapper/021:28:260
1128399524,42cyclictest0-21swapper/022:29:410
1128399524,41cyclictest0-21swapper/022:34:050
1128399523,44cyclictest0-21swapper/020:10:100
1128399523,43cyclictest0-21swapper/023:22:460
1128399523,42cyclictest0-21swapper/021:34:410
1129699519,36cyclictest0-21swapper/222:55:112
1129699515,39cyclictest0-21swapper/221:48:322
1129699514,41cyclictest0-21swapper/218:52:402
1129699514,40cyclictest0-21swapper/222:19:152
1129699514,40cyclictest0-21swapper/222:19:152
1129699514,40cyclictest0-21swapper/220:37:532
1129699514,40cyclictest0-21swapper/220:37:532
1129699514,20cyclictest0-21swapper/222:04:492
1129699513,43cyclictest0-21swapper/221:15:262
1129699513,43cyclictest0-21swapper/221:04:372
1129699512,6cyclictest4589-21latency_hist21:12:372
1128799519,8cyclictest0-21swapper/122:57:331
1128799515,8cyclictest0-21swapper/121:56:161
1128799514,13cyclictest0-21swapper/120:19:401
11287995122,23cyclictest26057-21sort20:57:371
11287995121,24cyclictest21140-21grep22:18:071
11287995121,24cyclictest21140-21grep22:18:071
11287995117,28cyclictest574-21dbus-daemon21:37:351
11287995117,28cyclictest557-21systemd-logind20:17:371
11287995115,6cyclictest14586-21processes18:13:081
1128399514,41cyclictest0-21swapper/023:29:020
1128399514,41cyclictest0-21swapper/021:20:000
1130399504,41cyclictest0-21swapper/318:13:373
1129699506,10cyclictest0-21swapper/220:42:502
1129699505,39cyclictest0-21swapper/222:47:222
1129699504,39cyclictest0-21swapper/222:38:072
1129699503,42cyclictest0-21swapper/221:31:362
1129699503,42cyclictest0-21swapper/221:31:362
1129699503,41cyclictest0-21swapper/221:38:162
1129699502,43cyclictest13008-21tune2fs22:07:522
1129699502,42cyclictest7892-21kworker/2:021:02:372
11296995012,32cyclictest0-21swapper/219:58:042
11287995016,28cyclictest10114-21cat22:47:531
11287995015,5cyclictest2310-21basename22:37:471
1128399505,39cyclictest0-21swapper/021:49:390
1128399504,40cyclictest0-21swapper/022:12:240
1128399504,40cyclictest0-21swapper/020:52:390
1128399504,39cyclictest0-21swapper/023:16:160
1128399503,42cyclictest0-21swapper/020:34:070
1128399503,41cyclictest0-21swapper/022:51:440
1129699498,35cyclictest0-21swapper/223:09:322
1129699494,8cyclictest0-21swapper/221:44:362
1129699494,39cyclictest0-21swapper/223:07:282
1129699494,39cyclictest0-21swapper/223:00:472
1129699494,39cyclictest0-21swapper/219:49:552
1129699494,38cyclictest0-21swapper/223:19:542
1129699493,9cyclictest0-21swapper/220:16:482
1129699493,41cyclictest0-21swapper/223:36:532
1129699493,41cyclictest0-21swapper/220:34:572
1129699493,41cyclictest0-21swapper/220:12:282
1129699493,40cyclictest0-21swapper/222:34:152
1129699493,40cyclictest0-21swapper/222:15:152
1129699493,40cyclictest0-21swapper/222:15:152
11296994913,31cyclictest0-21swapper/220:23:132
11296994911,5cyclictest0-21swapper/222:26:122
1128799497,36cyclictest26993-21latency_hist22:27:351
1128799494,14cyclictest0-21swapper/123:37:331
11287994919,25cyclictest16513-21forks22:12:481
11287994919,25cyclictest16513-21forks22:12:481
11287994918,26cyclictest667-21runrttasks20:26:021
11287994917,26cyclictest15718-21idleruntime20:42:521
11287994914,5cyclictest20039-21latency_hist23:02:341
11287994912,7cyclictest574-21dbus-daemon20:12:371
1128399497,36cyclictest0-21swapper/020:46:040
1128399494,39cyclictest0-21swapper/023:00:030
1128399494,39cyclictest0-21swapper/022:19:410
1128399494,39cyclictest0-21swapper/022:19:410
1128399494,39cyclictest0-21swapper/022:01:340
1128399494,39cyclictest0-21swapper/021:56:010
1128399493,40cyclictest588-21irqbalance20:19:280
1128399493,40cyclictest0-21swapper/023:08:240
1128399493,40cyclictest0-21swapper/021:16:360
11283994912,5cyclictest0-21swapper/022:45:340
11283994911,32cyclictest0-21swapper/022:38:590
109882499,16sleep20-21swapper/218:06:572
1130399484,38cyclictest0-21swapper/318:44:433
1130399483,41cyclictest0-21swapper/318:50:073
1129699484,38cyclictest0-21swapper/221:27:272
1129699484,38cyclictest0-21swapper/219:53:212
1129699483,40cyclictest0-21swapper/223:14:342
1129699483,39cyclictest0-21swapper/223:24:012
1129699483,38cyclictest0-21swapper/219:13:002
11296994810,32cyclictest0-21swapper/220:22:332
1128799484,17cyclictest0-21swapper/121:12:171
1128799482,42cyclictest30230-21fschecks_count19:02:531
11287994817,26cyclictest7918-21smart_sda19:28:051
11287994817,26cyclictest7918-21smart_sda19:28:051
11287994816,6cyclictest667-21runrttasks19:17:301
11287994816,5cyclictest7849-21sh22:00:411
11287994815,27cyclictest31249-21cut22:32:461
11287994815,27cyclictest19096-21diskstats20:47:491
11287994815,26cyclictest9589-21netstat19:33:011
11287994815,26cyclictest9589-21netstat19:33:011
11287994814,7cyclictest26632-21perl20:57:521
11287994814,6cyclictest14269-21latency_hist19:47:381
11287994814,5cyclictest19895-21latency_hist20:02:381
11287994812,6cyclictest32423-21kernelversion19:08:011
11287994812,5cyclictest0-21swapper/121:13:041
11287994812,4cyclictest0-21swapper/121:02:481
1128399485,37cyclictest0-21swapper/022:06:390
1128399484,39cyclictest0-21swapper/021:38:410
1128399484,39cyclictest0-21swapper/021:24:190
1128399484,38cyclictest0-21swapper/022:13:390
1128399484,38cyclictest0-21swapper/022:13:390
1128399484,38cyclictest0-21swapper/021:43:200
1128399484,38cyclictest0-21swapper/020:16:510
1128399483,40cyclictest0-21swapper/023:33:130
1130399474,38cyclictest0-21swapper/318:22:493
1130399472,15cyclictest15638-21/usr/sbin/munin18:18:013
11303994712,5cyclictest0-21swapper/318:33:063
11303994710,31cyclictest0-21swapper/321:32:573
1129699474,37cyclictest0-21swapper/222:49:462
1129699474,10cyclictest0-21swapper/220:03:132
1129699473,38cyclictest0-21swapper/218:59:502
1129699473,38cyclictest0-21swapper/218:27:402
1128799474,14cyclictest0-21swapper/121:22:581
1128799474,10cyclictest0-21swapper/118:23:041
1128799473,39cyclictest24414-21cat23:07:531
1128799473,12cyclictest0-21swapper/120:28:021
11287994715,7cyclictest27766-21basename22:27:541
11287994715,6cyclictest17646-21vmstat19:53:271
11287994715,5cyclictest16971-21timerandwakeup21:28:101
11287994715,5cyclictest16971-21timerandwakeup21:28:101
11287994714,7cyclictest15697-21sed19:48:181
11287994713,6cyclictest6197-21ntp_states23:28:021
11287994711,7cyclictest22372-21unixbench-2d18:33:111
11287994711,5cyclictest0-21swapper/119:21:151
11287994710,5cyclictest0-21swapper/120:33:141
11283994738,5cyclictest3-21ksoftirqd/018:57:390
1128399473,8cyclictest0-21swapper/020:57:470
1128399473,38cyclictest0-21swapper/021:04:580
1128399472,39cyclictest588-21irqbalance20:37:470
1128399472,39cyclictest588-21irqbalance20:37:470
1130399464,37cyclictest0-21swapper/322:04:073
1130399464,37cyclictest0-21swapper/319:12:513
1130399464,37cyclictest0-21swapper/319:08:123
1130399464,36cyclictest0-21swapper/321:17:403
1129699464,36cyclictest0-21swapper/218:08:182
1129699464,35cyclictest0-21swapper/218:34:532
11296994612,29cyclictest5187-21wget19:22:502
1128799466,9cyclictest23296-21fschecks_count21:37:521
1128799464,36cyclictest0-21swapper/123:14:101
1128799464,13cyclictest0-21swapper/123:02:561
1128799463,8cyclictest9503-21/usr/sbin/munin21:18:071
1128799463,10cyclictest32155-21grep23:18:061
11287994616,5cyclictest667-21runrttasks19:39:111
11287994616,24cyclictest12085-21basename20:37:521
11287994616,24cyclictest12085-21basename20:37:521
11287994615,6cyclictest5824-21/usr/sbin/munin22:42:501
11287994614,6cyclictest6772-21seq19:27:341
11287994613,7cyclictest23969-21expr18:42:501
11287994612,5cyclictest0-21swapper/120:02:381
1130399454,36cyclictest0-21swapper/318:57:443
1130399454,36cyclictest0-21swapper/318:31:423
1130399454,34cyclictest0-21swapper/320:28:013
1129699454,36cyclictest0-21swapper/219:28:412
1129699454,36cyclictest0-21swapper/219:28:412
1129699453,37cyclictest0-21swapper/219:32:552
1129699453,37cyclictest0-21swapper/219:32:552
1128799454,10cyclictest0-21swapper/122:07:481
110172455,15sleep10-21swapper/118:07:201
117512443,8sleep20-21swapper/219:38:122
1130399444,35cyclictest0-21swapper/318:53:153
1130399443,36cyclictest0-21swapper/318:08:023
1129699443,9cyclictest0-21swapper/218:40:462
1129699443,36cyclictest0-21swapper/219:42:482
1129699443,36cyclictest0-21swapper/219:11:422
1129699443,35cyclictest0-21swapper/219:04:572
1129699443,35cyclictest0-21swapper/218:57:402
1129699443,35cyclictest0-21swapper/218:12:522
11287994414,6cyclictest20188-21proc_pri18:28:091
1129699434,34cyclictest0-21swapper/218:32:402
1129699433,6cyclictest0-21swapper/218:22:402
1129699432,35cyclictest25392-21idleruntime-cro18:47:392
1128799437,7cyclictest25693-21chrt18:48:521
251292423,6sleep30-21swapper/321:39:393
179032423,6sleep30-21swapper/321:29:493
179032423,6sleep30-21swapper/321:29:493
1130399423,16cyclictest0-21swapper/318:39:493
1130399414,7cyclictest0-21swapper/321:17:373
11287994112,5cyclictest0-21swapper/118:39:461
78362403,6sleep30-21swapper/322:00:403
290702403,6sleep30-21swapper/323:14:023
50082393,7sleep30-21swapper/322:41:213
48262383,6sleep00-21swapper/019:21:400
1128399374,29cyclictest0-21swapper/019:48:350
1128399374,26cyclictest0-21swapper/019:17:400
1074123713,18sleep30-21swapper/318:04:013
103812373,7sleep00-21swapper/019:35:560
103812373,7sleep00-21swapper/019:35:560
256342363,7sleep00-21swapper/018:48:120
1130399364,28cyclictest0-21swapper/322:59:183
11303993627,5cyclictest37-21ksoftirqd/322:22:343
11303993627,5cyclictest37-21ksoftirqd/322:22:343
1128399365,26cyclictest0-21swapper/020:03:250
103992363,7sleep30-21swapper/319:36:113
103992363,7sleep30-21swapper/319:36:113
83242353,7sleep30-21swapper/322:45:363
252522353,7sleep00-21swapper/018:46:060
179472353,7sleep30-21swapper/319:56:563
1130399354,27cyclictest0-21swapper/322:22:423
11303993524,7cyclictest32052-21ssh23:18:053
11303993524,7cyclictest30184-21ntpq20:17:593
11303993524,7cyclictest1475-21grep20:23:023
11303993523,8cyclictest30709-21grep21:03:003
11303993520,11cyclictest27785-21if_err_eth222:27:543
11283993524,7cyclictest19405-21grep19:58:100
11283993519,11cyclictest121-17kauditd19:08:360
142232343,7sleep30-21swapper/319:47:063
1130399344,26cyclictest0-21swapper/321:47:163
1128399343,26cyclictest0-21swapper/019:47:350
11283993422,7cyclictest5448-21tune2fs19:22:540
1130399339,18cyclictest0-21swapper/321:48:033
1130399335,23cyclictest0-21swapper/320:37:483
1130399335,23cyclictest0-21swapper/320:37:483
1130399334,25cyclictest0-21swapper/320:09:463
1130399334,24cyclictest0-21swapper/320:13:553
11303993324,5cyclictest37-21ksoftirqd/320:47:363
11303993321,8cyclictest1882-21/usr/sbin/munin23:23:043
11303993320,9cyclictest6013-21awk23:27:573
1130399332,26cyclictest2221-21sed21:52:563
11283993320,8cyclictest16494-21egrep19:53:020
1092323311,16sleep00-21swapper/018:06:110
83502323,7sleep00-21swapper/019:29:000
83502323,7sleep00-21swapper/019:29:000
1130399324,23cyclictest0-21swapper/322:53:463
11303993222,6cyclictest32269-21grep22:33:063
11303993222,6cyclictest23814-21/usr/sbin/munin23:07:503
11303993221,7cyclictest8811-21ntpq20:33:053
1128399324,22cyclictest0-21swapper/018:32:500
1130399314,23cyclictest0-21swapper/320:57:593
1130399314,22cyclictest0-21swapper/322:13:543
1130399314,22cyclictest0-21swapper/322:13:543
11303993122,5cyclictest37-21ksoftirqd/321:27:363
11303993122,5cyclictest37-21ksoftirqd/319:52:373
1128399313,24cyclictest0-21swapper/019:07:060
11283993122,5cyclictest3-21ksoftirqd/018:32:390
1130399304,22cyclictest0-21swapper/323:32:413
1130399304,21cyclictest0-21swapper/323:02:463
1130399304,21cyclictest0-21swapper/319:38:463
1130399304,20cyclictest0-21swapper/319:27:553
1130399304,20cyclictest0-21swapper/319:27:553
1130399302,24cyclictest23934-21tail20:53:133
11303993019,6cyclictest37-21ksoftirqd/320:52:363
11303993017,8cyclictest1946-21cut21:08:003
1128399304,21cyclictest0-21swapper/018:58:040
1128399304,21cyclictest0-21swapper/018:17:490
1128399304,21cyclictest0-21swapper/018:07:450
11283993016,8cyclictest560-21NetworkManager18:22:410
11303992920,5cyclictest37-21ksoftirqd/320:07:373
1128399294,21cyclictest0-21swapper/018:41:390
1128399294,20cyclictest0-21swapper/019:37:450
1128399294,19cyclictest0-21swapper/018:12:500
1130399284,20cyclictest0-21swapper/319:23:193
1130399284,10cyclictest0-21swapper/319:17:423
11303992817,7cyclictest667-21runrttasks22:07:493
1130399274,19cyclictest0-21swapper/319:57:473
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional