You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-02-27 - 03:50
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack4slot1.osadl.org (updated Tue Feb 27, 2024 00:44:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
317321400,2sleep3321rcuc/323:20:473
317321400,2sleep3321rcuc/323:20:473
1888921320,2sleep0131rcu_preempt22:30:480
1888921320,2sleep0131rcu_preempt22:30:480
977321270,3sleep00-21swapper/023:27:030
977321270,3sleep00-21swapper/023:27:030
851521250,3sleep00-21swapper/022:52:140
851521250,3sleep00-21swapper/022:52:140
2863521230,10sleep333-21ksoftirqd/322:40:443
2863521230,10sleep333-21ksoftirqd/322:40:443
383021160,3sleep00-21swapper/023:55:000
383021160,3sleep00-21swapper/023:55:000
1268121060,3sleep30-21swapper/322:57:003
1268121060,3sleep30-21swapper/322:57:003
2927321040,3chrt0-21swapper/023:13:490
1419921000,2sleep00-21swapper/020:07:000
181202920,3sleep30-21swapper/320:16:593
298982870,2sleep30-21swapper/319:22:063
197202850,4sleep30-21swapper/300:12:083
197202850,4sleep30-21swapper/300:12:083
43202830,3sleep0151rcuc/000:32:110
43202830,3sleep0151rcuc/000:32:110
31072820,3sleep30-21swapper/322:14:393
31072820,3sleep30-21swapper/322:14:393
171442780,3chrt0-21swapper/300:09:313
171442780,3chrt0-21swapper/300:09:313
104272780,7sleep333-21ksoftirqd/300:01:593
104272780,7sleep333-21ksoftirqd/300:01:593
39192750,3sleep30-21swapper/300:32:023
39192750,3sleep30-21swapper/300:32:023
258142730,4sleep30-21swapper/321:31:483
274972710,3sleep30-21swapper/320:41:553
274972710,3sleep30-21swapper/320:41:553
58552700,3chrt0-21swapper/322:50:283
58552700,3chrt0-21swapper/322:50:283
295322650,3sleep10-21swapper/100:22:591
295322650,3sleep10-21swapper/100:22:591
9032630,3sleep00-21swapper/020:56:590
9032630,3sleep00-21swapper/020:56:590
8992620,3chrt0-21swapper/319:31:583
8992620,3chrt0-21swapper/319:31:583
2514199623,48cyclictest18925-21ssh00:11:562
2514199623,48cyclictest18925-21ssh00:11:562
24202550,3sleep00-21swapper/022:46:560
24202550,3sleep00-21swapper/022:46:560
109752550,2sleep011068-21sensors_temp00:02:090
109752550,2sleep011068-21sensors_temp00:02:090
148182540,2chrt0-21swapper/021:20:140
148182540,2chrt0-21swapper/021:20:140
162512530,2sleep00-21swapper/021:55:160
162512530,2sleep00-21swapper/021:55:160
15172510,2sleep21641-21/usr/sbin/munin23:52:062
15172510,2sleep21641-21/usr/sbin/munin23:52:062
250392500,2sleep30-21swapper/300:17:393
250392500,2sleep30-21swapper/300:17:393
103862500,11sleep333-21ksoftirqd/321:15:513
103862500,11sleep333-21ksoftirqd/321:15:513
57532490,3sleep30-21swapper/321:43:523
57532490,3sleep30-21swapper/321:43:523
29502490,2chrt2951-21/usr/sbin/munin21:01:570
164672490,3chrt0-21swapper/322:27:333
164672490,3chrt0-21swapper/322:27:333
96702480,3sleep00-21swapper/000:38:380
62492480,2sleep26420-21sort19:46:532
62492480,2sleep26420-21sort19:46:532
120042480,2sleep30-21swapper/322:23:153
120042480,2sleep30-21swapper/322:23:153
321942470,3chrt0-21swapper/000:27:000
321942470,3chrt0-21swapper/000:27:000
2514199473,32cyclictest22150-21ssh23:06:542
2514199473,32cyclictest22150-21ssh23:06:542
137932470,2sleep10-21swapper/121:18:421
137932470,2sleep10-21swapper/121:18:421
176262460,3sleep30-21swapper/323:35:543
176262460,3sleep30-21swapper/323:35:543
91762450,2sleep20-21swapper/222:53:092
91762450,2sleep20-21swapper/222:53:092
2514099451,32cyclictest7036-21sh22:51:511
2514099451,32cyclictest7036-21sh22:51:511
73272440,3sleep00-21swapper/021:46:100
73272440,3sleep00-21swapper/021:46:100
301592440,3sleep00-21swapper/022:09:140
301592440,3sleep00-21swapper/022:09:140
75562430,3sleep00-21swapper/023:24:580
25139994329,8cyclictest37650irq/55-eth021:46:520
25139994329,8cyclictest37650irq/55-eth021:46:520
223462420,3sleep30-21swapper/323:06:563
223462420,3sleep30-21swapper/323:06:563
311632410,3sleep031298-21grep21:36:590
311632410,3sleep031298-21grep21:36:590
18842410,2sleep12023-21users23:52:091
18842410,2sleep12023-21users23:52:091
98232390,2chrt0-21swapper/121:15:011
98232390,2chrt0-21swapper/121:15:011
56162390,2sleep30-21swapper/323:56:563
56162390,2sleep30-21swapper/323:56:563
56162390,2sleep30-21swapper/323:56:563
281902390,3sleep30-21swapper/300:22:053
281902390,3sleep30-21swapper/300:22:053
198122390,3sleep10-21swapper/100:12:101
198122390,3sleep10-21swapper/100:12:101
293852380,3sleep20-21swapper/222:41:392
293852380,3sleep20-21swapper/222:41:392
280642380,3sleep30-21swapper/322:06:593
280642380,3sleep30-21swapper/322:06:593
25141993722,8cyclictest27-21ksoftirqd/220:26:512
25141993722,8cyclictest27-21ksoftirqd/220:26:512
242642370,3sleep30-21swapper/323:42:023
242642370,3sleep30-21swapper/323:42:023
271072360,4sleep30-21swapper/319:16:553
271072360,4sleep30-21swapper/319:16:553
2514199361,29cyclictest27317-21ssh22:06:502
2514199361,29cyclictest27317-21ssh22:06:502
25139993617,15cyclictest131rcu_preempt22:21:520
25139993617,15cyclictest131rcu_preempt22:21:520
2513999360,32cyclictest25898-21ssh21:31:520
324622350,2sleep232473-21ssh22:44:132
324622350,2sleep232473-21ssh22:44:132
2514099352,27cyclictest9765-21ssh00:01:351
2514099352,27cyclictest9765-21ssh00:01:351
2514099352,27cyclictest9765-21ssh00:01:351
232772350,3sleep30-21swapper/321:28:173
232772350,3sleep30-21swapper/321:28:173
212962350,2sleep121309-21ssh22:00:231
183982350,3sleep10-21swapper/122:30:091
183982350,3sleep10-21swapper/122:30:091
256042340,2sleep00-21swapper/022:37:070
256042340,2sleep00-21swapper/022:37:070
2514199341,26cyclictest13756-21ssh23:31:542
2514199341,26cyclictest13756-21ssh23:31:542
2513999342,28cyclictest23463-21cat20:31:420
298392330,3sleep30-21swapper/323:47:323
298392330,3sleep30-21swapper/323:47:323
290032330,1sleep229108-21ssh00:22:212
290032330,1sleep229108-21ssh00:22:212
264332330,2sleep1201rcuc/123:11:371
264332330,2sleep1201rcuc/123:11:371
2514199333,23cyclictest9784-21sed00:01:352
2514199333,23cyclictest9784-21sed00:01:352
2514199333,23cyclictest9784-21sed00:01:352
2514199331,26cyclictest30693-21sh21:36:522
2514199331,26cyclictest30693-21sh21:36:522
2514099335,21cyclictest21-21ksoftirqd/120:26:511
2514099335,21cyclictest21-21ksoftirqd/120:26:511
152362330,3sleep10-21swapper/123:32:231
152362330,3sleep10-21swapper/123:32:231
286662320,2sleep128770-21latency23:46:591
286662320,2sleep128770-21latency23:46:591
278672320,26sleep127942-21find19:17:061
278672320,26sleep127942-21find19:17:061
2514199323,20cyclictest31595-21ssh23:16:522
2514199323,20cyclictest31595-21ssh23:16:522
2513999326,23cyclictest1462-21snmpd20:11:500
2513999326,23cyclictest1462-21snmpd20:11:500
25139993220,10cyclictest12-21ksoftirqd/020:31:400
2514299317,17cyclictest0-21swapper/322:01:523
2514299317,17cyclictest0-21swapper/322:01:523
2514199313,2cyclictest131rcu_preempt22:21:552
2514199313,2cyclictest131rcu_preempt22:21:552
2514099319,17cyclictest21-21ksoftirqd/122:16:501
2514099312,22cyclictest19935-21ssh22:31:541
2514099312,22cyclictest19935-21ssh22:31:541
25139993125,4cyclictest9670-21latency_hist00:01:370
25139993125,4cyclictest9670-21latency_hist00:01:370
25139993125,4cyclictest9670-21latency_hist00:01:370
72012300,2sleep10-21swapper/121:45:591
72012300,2sleep10-21swapper/121:45:591
305232300,2sleep00-21swapper/023:48:330
305232300,2sleep00-21swapper/023:48:330
2514199302,3cyclictest131rcu_preempt22:12:092
2514199302,3cyclictest131rcu_preempt22:12:092
2514099302,22cyclictest18491-21ssh23:36:521
25139993019,9cyclictest12-21ksoftirqd/022:41:510
25139993019,9cyclictest12-21ksoftirqd/022:41:510
2513999301,24cyclictest27760-21taskset00:21:570
2513999301,24cyclictest27760-21taskset00:21:570
2513999301,24cyclictest0-21swapper/019:31:520
2513999301,24cyclictest0-21swapper/019:31:520
110942300,3chrt0-21swapper/021:16:360
110942300,3chrt0-21swapper/021:16:360
100452300,4sleep30-21swapper/323:27:063
100452300,4sleep30-21swapper/323:27:063
2514299295,16cyclictest0-21swapper/321:36:533
2514299295,16cyclictest0-21swapper/321:36:533
25140992912,3cyclictest21-21ksoftirqd/100:06:581
25140992912,3cyclictest21-21ksoftirqd/100:06:581
235132290,3sleep00-21swapper/023:41:500
235132290,3sleep00-21swapper/023:41:500
228812290,4sleep10-21swapper/122:01:551
228812290,4sleep10-21swapper/122:01:551
2514299285,17cyclictest0-21swapper/323:21:543
2514199281,22cyclictest0-21swapper/222:31:542
2514199281,22cyclictest0-21swapper/222:31:542
2514099282,20cyclictest16181-21ssh21:21:571
2514099282,20cyclictest16181-21ssh21:21:571
2513999286,19cyclictest32198-21ssh22:11:530
2513999286,19cyclictest32198-21ssh22:11:530
2513999283,21cyclictest14306-21ssh00:06:550
2513999283,21cyclictest14306-21ssh00:06:550
2513999282,22cyclictest21183-21ssh21:26:570
2513999282,22cyclictest21183-21ssh21:26:570
25139992815,10cyclictest0-21swapper/023:21:410
25139992815,10cyclictest0-21swapper/023:21:410
250752283,15sleep124854-21ls19:11:431
250752283,15sleep124854-21ls19:11:431
183622280,2sleep333-21ksoftirqd/323:36:433
14822280,3sleep30-21swapper/322:46:143
14822280,3sleep30-21swapper/322:46:143
2513999273,9cyclictest131rcu_preempt20:36:500
2513999273,9cyclictest131rcu_preempt20:36:500
2513999272,22cyclictest0-21swapper/000:16:570
2513999272,22cyclictest0-21swapper/000:16:570
186842270,3sleep30-21swapper/321:23:473
186842270,3sleep30-21swapper/321:23:473
12032270,3sleep30-21swapper/300:27:533
12032270,3sleep30-21swapper/300:27:533
252422260,3chrt25243-21latency_hist20:36:380
252422260,3chrt25243-21latency_hist20:36:380
2514299267,13cyclictest0-21swapper/323:11:523
2514299265,15cyclictest0-21swapper/322:16:513
2514299262,16cyclictest0-21swapper/321:46:533
2514299262,16cyclictest0-21swapper/321:46:533
2514199264,16cyclictest11411-21ssh21:16:542
2514199264,16cyclictest11411-21ssh21:16:542
2514199262,3cyclictest131rcu_preempt21:32:062
2514099264,16cyclictest12136-21ssh22:56:541
2514099264,16cyclictest12136-21ssh22:56:541
2514099263,19cyclictest30707-21ssh21:36:531
2514099263,19cyclictest30707-21ssh21:36:531
25140992613,9cyclictest4102-21cut23:21:411
25140992613,9cyclictest4102-21cut23:21:411
25139992617,7cyclictest12-21ksoftirqd/023:41:400
2513999261,4cyclictest0-21swapper/023:01:520
2513999261,4cyclictest0-21swapper/023:01:520
25139992614,8cyclictest1462-21snmpd20:16:520
25139992611,4cyclictest12-21ksoftirqd/019:27:050
25139992611,4cyclictest12-21ksoftirqd/019:27:050
25139992611,4cyclictest12-21ksoftirqd/019:27:050
305472250,3sleep20-21swapper/223:48:352
305472250,3sleep20-21swapper/223:48:352
25142992518,4cyclictest321rcuc/320:30:553
25142992518,4cyclictest321rcuc/320:30:553
2513999252,2cyclictest0-21swapper/020:01:490
250742254,13sleep024854-21ls19:11:420
250742254,13sleep024854-21ls19:11:420
164582250,2sleep30-21swapper/321:55:343
164582250,2sleep30-21swapper/321:55:343
2514299243,17cyclictest0-21swapper/322:31:543
2514299243,17cyclictest0-21swapper/322:31:543
2514199244,6cyclictest27-21ksoftirqd/219:22:042
2514199243,12cyclictest16174-21ssh21:21:562
2514199243,12cyclictest16174-21ssh21:21:562
2514199241,19cyclictest26756-21ssh23:11:522
2514099241,3cyclictest0-21swapper/121:30:311
2514099241,3cyclictest0-21swapper/121:30:311
25140992412,9cyclictest9805-21ssh00:38:551
25140992411,10cyclictest6074-21diskmemload23:22:091
25140992411,10cyclictest11875-21apt-get20:01:511
2513999241,19cyclictest22128-21latency_hist22:01:410
2513999241,18cyclictest22567-21ssh22:01:520
2513999241,18cyclictest22567-21ssh22:01:520
316132230,4sleep30-21swapper/319:27:043
316132230,4sleep30-21swapper/319:27:043
316132230,4sleep30-21swapper/319:27:043
2514199233,7cyclictest27-21ksoftirqd/221:28:002
2514199233,7cyclictest27-21ksoftirqd/221:28:002
2514199232,17cyclictest17606-21ssh21:56:522
2514199231,19cyclictest19732-21ls23:37:072
25140992311,9cyclictest23493-21apt-get20:31:501
25140992311,9cyclictest23493-21apt-get20:31:501
2513999234,10cyclictest23202-21latency_hist00:16:400
2513999234,10cyclictest23202-21latency_hist00:16:400
2513999233,17cyclictest1462-21snmpd19:36:510
2513999233,17cyclictest1462-21snmpd19:36:510
2513999232,19cyclictest12-21ksoftirqd/019:21:530
2513999231,16cyclictest753-21systemd-journal19:55:040
2513999231,16cyclictest753-21systemd-journal19:55:040
242512230,3sleep00-21swapper/022:36:190
242512230,3sleep00-21swapper/022:36:190
25142992216,4cyclictest321rcuc/320:33:323
25142992216,4cyclictest321rcuc/320:33:323
2514199227,4cyclictest26660-21kworker/u8:520:46:322
2514199227,4cyclictest26660-21kworker/u8:520:46:322
2514199222,3cyclictest131rcu_preempt23:01:522
2514199222,3cyclictest131rcu_preempt23:01:522
2514199222,15cyclictest26993-21apt-get19:16:522
2514199222,15cyclictest26993-21apt-get19:16:522
2514199221,2cyclictest131rcu_preempt23:27:062
2514199221,2cyclictest131rcu_preempt23:27:062
2514199221,16cyclictest12133-21rm22:56:542
2514199221,16cyclictest12133-21rm22:56:542
25141992211,3cyclictest27-21ksoftirqd/221:43:552
25141992211,3cyclictest27-21ksoftirqd/221:43:552
2514099229,10cyclictest17189-21sh23:01:551
2514099229,10cyclictest17189-21sh23:01:551
2514099221,3cyclictest131rcu_preempt22:11:561
2514099221,3cyclictest131rcu_preempt22:11:561
2514099221,16cyclictest2269-21ls22:46:541
2514099221,16cyclictest2269-21ls22:46:541
25139992211,9cyclictest22130-21apt-get23:06:540
25139992211,9cyclictest22130-21apt-get23:06:540
25139992211,9cyclictest12-21ksoftirqd/020:21:520
25139992211,9cyclictest12-21ksoftirqd/020:21:520
2513999221,18cyclictest27498-21tune2fs20:41:550
2513999221,18cyclictest27498-21tune2fs20:41:550
2513999221,12cyclictest5108-21/usr/sbin/munin22:16:550
250812223,10sleep224854-21ls19:11:492
250812223,10sleep224854-21ls19:11:492
203262220,3chrt0-21swapper/021:26:050
203262220,3chrt0-21swapper/021:26:050
25142992116,3cyclictest321rcuc/322:00:543
25142992116,3cyclictest321rcuc/300:37:373
25142992115,4cyclictest321rcuc/320:22:593
25142992115,4cyclictest321rcuc/320:22:593
2514199218,2cyclictest131rcu_preempt00:37:102
25141992114,5cyclictest18121-21needreboot20:16:592
2514199211,11cyclictest82232ssh21:12:372
2514199211,11cyclictest82232ssh21:12:372
2514199211,11cyclictest105952ntp_states19:56:582
2514199211,11cyclictest105952ntp_states19:56:582
2514099218,10cyclictest1129-21rt-features19:32:031
2514099218,10cyclictest1129-21rt-features19:32:031
2514099212,4cyclictest131rcu_preempt23:11:521
2514099212,11cyclictest32055-21sh22:43:411
2514099212,11cyclictest32055-21sh22:43:411
25140992113,6cyclictest15088-21ssh21:53:281
25140992113,6cyclictest15088-21ssh21:53:281
25140992111,3cyclictest21-21ksoftirqd/100:03:021
25140992111,3cyclictest21-21ksoftirqd/100:03:021
2514099210,18cyclictest20564-21ls20:22:071
2514099210,18cyclictest20564-21ls20:22:071
2513999212,4cyclictest131rcu_preempt19:41:510
2513999212,4cyclictest131rcu_preempt19:41:510
25139992114,3cyclictest12-21ksoftirqd/020:46:530
2514299203,12cyclictest0-21swapper/322:51:513
2514299203,12cyclictest0-21swapper/322:51:513
2514299203,12cyclictest0-21swapper/319:11:523
2514299203,12cyclictest0-21swapper/319:11:523
25142992015,3cyclictest321rcuc/320:12:183
25142992015,3cyclictest321rcuc/320:12:183
25142992014,4cyclictest321rcuc/320:09:133
2514199205,3cyclictest131rcu_preempt22:28:052
2514199205,3cyclictest131rcu_preempt22:28:052
2514199202,4cyclictest131rcu_preempt19:31:532
2514199202,4cyclictest131rcu_preempt19:31:532
2514199201,5cyclictest27-21ksoftirqd/221:06:592
2514199201,5cyclictest27-21ksoftirqd/221:06:592
25141992013,5cyclictest25538-21ssh23:43:072
25141992013,5cyclictest25538-21ssh23:43:072
2514199200,3cyclictest131rcu_preempt22:46:552
2514199200,3cyclictest131rcu_preempt22:46:552
2514099203,15cyclictest690-21runrttasks19:31:171
2514099203,15cyclictest690-21runrttasks19:31:171
2514099203,15cyclictest690-21runrttasks19:31:171
25140992012,6cyclictest10495-21ssh23:27:211
25140992012,6cyclictest10495-21ssh23:27:211
25140992011,6cyclictest26021-21ntpq20:36:591
25140992011,6cyclictest26021-21ntpq20:36:591
2514099200,18cyclictest4535-21ls00:32:151
2514099200,18cyclictest4535-21ls00:32:151
2513999202,14cyclictest12887-21ntp_states22:57:030
2513999202,14cyclictest12887-21ntp_states22:57:030
2513999201,9cyclictest31643-21uname20:52:000
2513999201,9cyclictest31643-21uname20:52:000
25139992011,7cyclictest12-21ksoftirqd/019:46:490
25139992011,7cyclictest12-21ksoftirqd/019:46:490
2513999201,11cyclictest10104-21fschecks_count19:56:520
2513999201,11cyclictest10104-21fschecks_count19:56:520
59312190,4sleep121-21ksoftirqd/119:46:351
59312190,4sleep121-21ksoftirqd/119:46:351
2514299194,10cyclictest0-21swapper/323:51:533
2514299194,10cyclictest0-21swapper/323:51:533
2514299194,10cyclictest0-21swapper/323:01:533
2514299194,10cyclictest0-21swapper/323:01:533
2514299193,10cyclictest0-21swapper/321:16:543
2514299193,10cyclictest0-21swapper/321:16:543
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional