You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-04-21 - 06:33
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack2slot7.osadl.org (updated Sun Apr 21, 2024 00:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
74224499431,2cyclictest0-21swapper/023:41:190
74224499349,18cyclictest1002-21mta-sts-daemon00:16:190
74224499331,23cyclictest0-21swapper/023:58:130
74224499301,22cyclictest0-21swapper/022:36:170
742245992912,6cyclictest11050irq/107-eth%d23:41:191
74224599288,16cyclictest1003-21mta-sts-daemon23:06:141
74224499273,23cyclictest0-21swapper/000:36:200
742244992618,1cyclictest0-21swapper/000:05:550
742244992518,5cyclictest0-21swapper/021:36:190
74224599241,20cyclictest82853750ssh23:21:521
74224499245,11cyclictest11050irq/107-eth%d23:21:520
74224499240,20cyclictest0-21swapper/022:59:200
74224499232,20cyclictest0-21swapper/023:30:140
742244992316,5cyclictest0-21swapper/021:31:190
742244992310,4cyclictest0-21swapper/023:03:330
74224499221,19cyclictest0-21swapper/022:50:590
112299220,5rtkit-daemon1003-21mta-sts-daemon23:32:200
74224699216,9cyclictest0-21swapper/200:36:202
742245992114,5cyclictest1000-21mta-sts-daemon23:58:141
74224599200,3cyclictest171rcu_preempt22:46:541
74224499207,7cyclictest742201-21munin-run19:11:180
74224499202,18cyclictest0-21swapper/023:10:110
74224499201,19cyclictest0-21swapper/021:50:220
74224499200,19cyclictest742485-21munin-run19:16:190
112299200,3rtkit-daemon1121-21rtkit-daemon22:18:451
74224599193,10cyclictest839052-21ssh23:39:041
74224499196,4cyclictest797115-21sh22:31:190
74224499190,10cyclictest871851-21sed00:36:200
112299190,6rtkit-daemon1001-21mta-sts-daemon22:05:551
112299190,5rtkit-daemon1002-21mta-sts-daemon21:38:132
74224699184,11cyclictest857791-21ssh00:10:182
74224699182,10cyclictest11050irq/107-eth%d00:16:192
74224599182,10cyclictest849711-21latency_hist23:56:191
74224499185,8cyclictest0-21swapper/022:15:170
74224599162,11cyclictest803447-21grep22:41:191
74224499163,11cyclictest744773-21munin-plugin-st20:01:190
74224499160,1cyclictest0-21swapper/023:54:020
74224799152,6cyclictest0-21swapper/300:02:143
74224699152,9cyclictest815562-21run-parts23:01:192
74224699151,9cyclictest840196-21munin-plugin-st23:41:182
74224699151,3cyclictest781924-21latency_hist22:06:192
742246991513,2cyclictest1002-21mta-sts-daemon23:19:082
74224599152,6cyclictest775657-21idleruntime-cro21:56:191
742245991511,3cyclictest827995-21munin-plugin-st23:21:181
74224499153,10cyclictest742744-21ls19:21:180
74224499152,13cyclictest0-21swapper/023:14:070
74224499152,10cyclictest746252-21grep20:26:190
74224499151,9cyclictest828127-21latency_hist23:21:190
742244991511,2cyclictest0-21swapper/021:40:500
112299150,3rtkit-daemon1121-21rtkit-daemon21:17:130
112299150,1rtkit-daemon0-21swapper/120:55:371
74224799142,8cyclictest0-21swapper/322:40:543
74224699149,4cyclictest613-21gpm00:35:142
74224699148,4cyclictest824896-21grep23:16:192
74224699144,8cyclictest748087-21cron21:06:182
74224699144,7cyclictest806874-21apt-get22:46:542
74224699142,9cyclictest58-21kcompactd023:21:522
74224599141,4cyclictest171rcu_preempt22:31:191
742245991410,3cyclictest1003-21mta-sts-daemon21:47:001
74224499146,2cyclictest840195-21munin-run23:41:180
742244991412,1cyclictest0-21swapper/022:11:080
74224499141,12cyclictest751353-21latency_hist21:16:190
742244991411,2cyclictest1000-21mta-sts-daemon22:51:280
74224499141,11cyclictest748340-21diskmemload21:25:010
74224499140,9cyclictest790697-21ssh22:20:540
74224799133,6cyclictest0-21swapper/323:21:523
74224699134,3cyclictest797315-21latency_hist22:31:192
74224699131,9cyclictest760653-21cat21:31:192
742246991310,2cyclictest745803-21sendmail20:21:192
74224599139,3cyclictest1000-21mta-sts-daemon23:47:061
74224599133,8cyclictest861234-21ssh00:16:191
74224599132,8cyclictest778828-21ssh22:01:191
742245991311,1cyclictest1003-21mta-sts-daemon22:42:361
74224599131,10cyclictest873920-21basename00:41:191
742245991310,2cyclictest745531-21cron20:16:191
74224599130,11cyclictest742488-21cut19:16:191
74224499131,8cyclictest0-21swapper/023:50:300
74224499131,8cyclictest0-21swapper/022:44:080
74224499131,8cyclictest0-21swapper/022:22:590
74224499131,8cyclictest0-21swapper/021:56:460
74224499131,8cyclictest0-21swapper/021:54:220
74224499131,8cyclictest0-21swapper/021:43:070
74224499131,8cyclictest0-21swapper/000:26:220
74224499131,8cyclictest0-21swapper/000:14:240
74224499131,8cyclictest0-21swapper/000:06:450
74224499130,8cyclictest779159-21ssh22:01:400
74224499130,8cyclictest0-21swapper/000:21:280
112299130,2rtkit-daemon1121-21rtkit-daemon20:01:542
112299130,1rtkit-daemon0-21swapper/121:24:011
112299130,0rtkit-daemon0-21swapper/020:26:450
74224799125,4cyclictest0-21swapper/323:56:193
74224799123,4cyclictest0-21swapper/323:01:193
74224799122,5cyclictest0-21swapper/322:46:543
74224699129,2cyclictest1003-21mta-sts-daemon00:22:362
74224699129,2cyclictest1000-21mta-sts-daemon23:56:202
74224699126,5cyclictest849709-21ssh23:56:192
74224699124,6cyclictest772794-21ssh21:51:192
74224699123,5cyclictest742593-21latency_hist19:16:192
74224699123,4cyclictest790957-21plymouth22:21:192
74224699121,9cyclictest778721-21munin-run22:01:192
742246991210,1cyclictest1003-21mta-sts-daemon23:46:582
74224699120,9cyclictest747264-21wc20:46:192
74224599129,2cyclictest1003-21mta-sts-daemon00:09:021
74224599125,5cyclictest742745-21latency_hist19:21:181
74224599123,5cyclictest742382-21latency_hist19:11:191
74224599122,7cyclictest745801-21munin-run20:21:191
74224599121,9cyclictest744707-21grep19:56:191
74224599121,8cyclictest837241-21idleruntime-cro23:36:191
74224599121,7cyclictest747469-21grep20:51:191
74224499129,2cyclictest0-21swapper/020:41:190
74224499124,5cyclictest0-21swapper/020:46:190
74224499121,9cyclictest748346-21munin-plugin-st21:11:190
74224499121,7cyclictest0-21swapper/022:39:070
112299120,0rtkit-daemon0-21swapper/219:24:172
112299120,0rtkit-daemon0-21swapper/219:24:172
74224799114,4cyclictest0-21swapper/323:26:423
74224799113,4cyclictest0-21swapper/322:01:193
74224799111,5cyclictest0-21swapper/323:09:593
74224699119,1cyclictest748334-21cron21:11:192
74224699118,2cyclictest1003-21mta-sts-daemon22:40:092
74224699118,2cyclictest1002-21mta-sts-daemon22:23:502
74224699117,2cyclictest1003-21mta-sts-daemon00:26:362
74224699111,8cyclictest321-21systemd-journal19:41:192
74224699111,6cyclictest806488-21latency_hist22:46:192
74224699111,6cyclictest742947-21latency_hist19:21:192
74224699111,4cyclictest775648-21cron21:56:192
74224699111,1cyclictest11050irq/107-eth%d00:16:182
74224699110,9cyclictest812477-21cron22:56:182
74224699110,7cyclictest837227-21cron23:36:192
74224699110,2cyclictest0-21swapper/221:19:442
74224599119,1cyclictest1002-21mta-sts-daemon22:24:261
74224599119,1cyclictest1000-21mta-sts-daemon00:21:401
74224599117,3cyclictest747910-21grep21:01:191
74224599114,6cyclictest769674-21latency_hist21:46:191
74224599113,6cyclictest824856-21latency_hist23:16:191
74224599113,6cyclictest587-21mta-sts-daemon00:15:091
74224599112,8cyclictest619-21systemd-logind23:11:191
74224599112,6cyclictest784850-21munin-run22:11:181
74224599111,8cyclictest812556-21grep22:56:191
74224599111,8cyclictest746798-21cron20:41:181
74224599111,7cyclictest575-21avahi-daemon23:26:541
74224499112,8cyclictest745034-21cron20:06:180
74224499112,6cyclictest746665-21latency_hist20:36:190
74224499111,5cyclictest743159-21grep19:26:190
74224499111,5cyclictest743159-21grep19:26:190
112299110,2rtkit-daemon1003-21mta-sts-daemon23:08:252
112299110,1rtkit-daemon0-21swapper/020:12:030
74224799102,4cyclictest0-21swapper/319:41:193
74224799102,4cyclictest0-21swapper/300:24:053
74224799102,4cyclictest0-21swapper/300:10:183
74224799102,3cyclictest0-21swapper/323:01:233
74224799101,6cyclictest0-21swapper/322:31:193
74224699108,1cyclictest1001-21mta-sts-daemon23:27:272
74224699107,2cyclictest817004-21ssh23:03:242
74224699107,2cyclictest768534-21ssh21:44:242
74224699107,2cyclictest1001-21mta-sts-daemon23:45:202
74224699105,4cyclictest989-21lldpd21:21:352
74224699101,7cyclictest743576-21grep19:36:192
74224699100,8cyclictest747823-21munin-plugin-st21:01:192
74224699100,7cyclictest745573-21latency_hist20:16:192
74224599108,2cyclictest766467-21ssh21:41:091
74224599107,2cyclictest81320150ssh22:57:131
74224599107,2cyclictest1003-21mta-sts-daemon21:35:571
74224599106,3cyclictest805-21wpa_supplicant00:31:201
74224599103,5cyclictest787878-21systemd-run22:16:191
74224599103,2cyclictest11050irq/107-eth%d21:11:191
74224599102,6cyclictest747078-21munin-run20:46:191
74224599102,5cyclictest11050irq/107-eth%d22:36:171
74224599101,7cyclictest743507-21munin-run19:36:191
74224599101,6cyclictest751506-21cat21:16:191
74224599100,7cyclictest321-21systemd-journal19:26:191
74224599100,7cyclictest321-21systemd-journal19:26:191
74224499108,1cyclictest11050irq/107-eth%d19:43:160
74224499101,7cyclictest747509-21wc20:51:190
74224499100,2cyclictest745275-21sshd20:08:090
112299100,1rtkit-daemon0-21swapper/121:16:381
7422479993,4cyclictest0-21swapper/321:21:193
7422479993,3cyclictest0-21swapper/323:18:363
7422479993,3cyclictest0-21swapper/323:13:553
7422479992,4cyclictest0-21swapper/323:49:193
7422479992,4cyclictest0-21swapper/322:06:363
7422479992,3cyclictest0-21swapper/321:46:063
7422479992,3cyclictest0-21swapper/320:46:193
7422479991,5cyclictest0-21swapper/322:33:153
7422479991,5cyclictest0-21swapper/322:22:283
7422479991,5cyclictest0-21swapper/300:16:193
7422479991,5cyclictest0-21swapper/300:12:323
7422479991,4cyclictest0-21swapper/322:41:423
7422479991,3cyclictest0-21swapper/300:41:193
7422479990,7cyclictest0-21swapper/321:51:523
7422479990,5cyclictest0-21swapper/323:51:563
7422479990,5cyclictest0-21swapper/322:51:543
7422469997,2cyclictest748664-21ssh21:11:292
7422469997,1cyclictest0-21swapper/219:11:192
7422469995,3cyclictest853475-21ssh00:02:192
7422469995,3cyclictest797452-21ssh22:31:312
7422469995,3cyclictest785078-21ssh22:11:232
7422469995,3cyclictest782292-21ssh22:06:502
7422469995,3cyclictest760838-21ssh21:31:362
7422469995,3cyclictest743998-21sshd19:41:542
7422469991,6cyclictest747468-21cat20:51:192
7422469991,5cyclictest744421-21latency_hist19:51:192
7422469991,4cyclictest744522-21idleruntime-cro19:56:182
7422469990,6cyclictest744937-21cat20:01:192
7422459997,1cyclictest0-21swapper/119:46:191
7422459995,3cyclictest866746-21ssh00:26:301
7422459995,3cyclictest853338-21ssh00:02:021
7422459995,3cyclictest758603-21ssh21:28:001
7422459991,5cyclictest744900-21latency_hist20:01:191
7422459991,4cyclictest587-21mta-sts-daemon20:09:541
7422449993,4cyclictest745809-21idleruntime-cro20:21:190
7422449992,5cyclictest748094-21cron21:06:180
7422449991,2cyclictest744275-21munin-run19:51:190
7422449991,1cyclictest0-21swapper/019:35:500
7422449990,8cyclictest747826-21munin-run21:01:190
7422449990,7cyclictest744526-21cut19:56:180
7422479984,3cyclictest0-21swapper/323:41:193
7422479982,4cyclictest0-21swapper/323:32:543
7422479982,4cyclictest0-21swapper/322:17:483
7422479982,3cyclictest0-21swapper/321:36:193
7422479982,3cyclictest0-21swapper/321:26:443
7422479981,5cyclictest0-21swapper/323:36:263
7422479981,5cyclictest0-21swapper/300:31:223
7422479981,4cyclictest0-21swapper/322:02:333
7422479980,5cyclictest0-21swapper/321:41:193
7422479980,4cyclictest0-21swapper/321:46:293
7422469987,1cyclictest11050irq/107-eth%d20:21:552
7422469985,2cyclictest3886975-21snmpd20:56:102
7422469984,3cyclictest697-21in:imuxsock20:41:182
7422469983,3cyclictest321-21systemd-journal20:31:182
7422469981,4cyclictest746666-21grep20:36:192
7422469980,5cyclictest743287-21latency_hist19:31:182
7422459986,2cyclictest697-21in:imuxsock19:31:181
7422459981,5cyclictest743778-21idleruntime-cro19:41:191
7422459981,4cyclictest746548-21cron20:36:191
7422459980,6cyclictest748285-21latency_hist21:06:191
7422449981,6cyclictest747573-21grep20:56:180
7422449981,5cyclictest743443-21grep19:31:180
11229980,6rtkit-daemon1121-21rtkit-daemon19:46:231
11229980,4rtkit-daemon0-21swapper/019:39:160
7422479972,3cyclictest0-21swapper/300:26:193
7422479972,2cyclictest0-21swapper/321:23:083
7422479972,2cyclictest0-21swapper/320:11:193
7422479972,2cyclictest0-21swapper/320:06:183
7422479972,2cyclictest0-21swapper/319:51:193
7422479971,3cyclictest0-21swapper/321:11:573
7422479971,3cyclictest0-21swapper/321:11:193
7422479971,3cyclictest0-21swapper/320:41:183
7422479971,3cyclictest0-21swapper/319:46:183
7422479970,4cyclictest0-21swapper/322:11:403
7422469971,5cyclictest745363-21latency_hist20:11:192
7422459974,2cyclictest746293-21sshd20:28:111
7422459971,4cyclictest1037-21cron20:06:181
7422479962,3cyclictest0-21swapper/319:21:183
7422479961,3cyclictest0-21swapper/321:01:193
7422479960,3cyclictest0-21swapper/320:31:183
7422459961,3cyclictest746055-21cron20:26:191
7422479953,2cyclictest0-21swapper/320:21:193
7422479952,2cyclictest0-21swapper/320:00:543
7422479951,2cyclictest0-21swapper/321:02:543
7422479951,2cyclictest0-21swapper/320:26:193
7422479951,2cyclictest0-21swapper/320:16:193
7422479951,2cyclictest0-21swapper/319:11:543
7422479951,1cyclictest0-21swapper/319:56:193
7422479942,1cyclictest0-21swapper/319:34:543
7422479941,2cyclictest0-21swapper/320:56:183
7422479941,2cyclictest0-21swapper/320:51:193
7422479941,2cyclictest0-21swapper/319:27:543
7422479941,2cyclictest0-21swapper/319:26:193
7422479941,2cyclictest0-21swapper/319:26:193
7422479941,1cyclictest0-21swapper/320:36:193
7422479941,1cyclictest0-21swapper/319:11:183
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional