You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-06-17 - 22:45
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack2slot7.osadl.org (updated Mon Jun 17, 2024 12:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
70288699432,27cyclictest799182-21memory10:27:040
702886993823,1cyclictest0-21swapper/011:47:070
70288899353,9cyclictest11050irq/107-eth%d11:32:052
702887993528,2cyclictest833872-21latency_hist11:17:091
702886993528,3cyclictest833515-21ssh11:17:070
70288699324,22cyclictest801739-21/usr/sbin/munin10:31:560
70288699321,23cyclictest0-21swapper/011:27:020
70288699312,14cyclictest0-21swapper/011:17:100
702886993116,4cyclictest806275-21ntpq10:37:130
702886993111,5cyclictest11050irq/107-eth%d11:32:070
70288699307,7cyclictest0-21swapper/011:32:390
70288699303,4cyclictest0-21swapper/012:07:070
70288699302,27cyclictest0-21swapper/012:12:090
70288699293,13cyclictest781758-21ssh10:02:040
70288699291,3cyclictest865719-21grep12:02:050
70288699277,12cyclictest0-21swapper/011:02:110
702886992720,1cyclictest0-21swapper/010:12:200
702887992621,4cyclictest829234-21fschecks_count11:11:571
702886992626,0cyclictest0-21swapper/009:57:020
70288899252,3cyclictest0-21swapper/210:47:152
112299250,11rtkit-daemon767086-21ssh09:42:092
702886992414,1cyclictest0-21swapper/010:34:590
70288699241,22cyclictest785059-21/usr/sbin/munin10:07:020
702887992318,3cyclictest857264-21fschecks_count11:51:581
70288699239,1cyclictest816202-21ssh10:52:130
70288699232,18cyclictest0-21swapper/010:46:560
70288699231,2cyclictest773703-21fschecks_count09:52:020
70288699231,17cyclictest0-21swapper/010:17:190
70288699230,1cyclictest718344-21ntpq07:57:080
70288699230,16cyclictest884216-21/usr/sbin/munin12:26:590
702888992217,4cyclictest840346-21unixbench_multi11:27:072
70288699223,18cyclictest881384-21sed12:22:000
702886992219,2cyclictest888863-21idleruntime-cro12:32:090
70288699220,21cyclictest0-21swapper/010:59:140
70288699220,1cyclictest0-21swapper/009:07:090
702887992117,3cyclictest0-21swapper/110:26:591
702886992112,3cyclictest0-21swapper/009:21:560
70288899203,9cyclictest726815-21/usr/sbin/munin08:22:092
702887992016,3cyclictest784930-21gltestperf10:07:011
702886992010,4cyclictest579-21dbus-daemon09:37:100
70288999192,10cyclictest0-21swapper/310:52:013
70288899192,15cyclictest858224-21sort11:52:092
702888991915,3cyclictest758263-21fschecks_time09:32:002
702887991916,2cyclictest715871-21unixbench_singl07:47:141
702887991914,4cyclictest834166-21unixbench_multi11:17:121
70288699194,9cyclictest0-21swapper/011:52:020
702886991919,0cyclictest0-21swapper/011:40:100
702886991915,3cyclictest0-21swapper/007:57:090
70288699191,2cyclictest767107-21munin-run09:42:090
70288899181,5cyclictest865720-21sendmail_mailqu12:02:052
702888991814,3cyclictest716201-21fschecks_count07:52:002
702888991812,4cyclictest751244-21sh09:22:092
70288799181,3cyclictest11050irq/107-eth%d12:07:071
702887991812,5cyclictest866124-21idleruntime-cro12:02:091
70288799181,11cyclictest0-21swapper/110:31:561
70288799180,5cyclictest795725-21/usr/sbin/munin10:22:081
702886991813,2cyclictest0-21swapper/010:52:030
112299180,4rtkit-daemon1121-21rtkit-daemon10:39:151
112299180,2rtkit-daemon1121-21rtkit-daemon09:37:231
70288999175,4cyclictest0-21swapper/311:21:543
70288899176,9cyclictest816679-21ssh10:52:182
70288899173,9cyclictest851158-21sed11:42:092
70288899173,3cyclictest833911-21/usr/sbin/munin11:17:102
70288899172,12cyclictest808802-21cut10:41:582
702888991713,3cyclictest738086-21cron08:57:092
702888991711,4cyclictest1002-21mta-sts-daemon12:27:062
702888991710,4cyclictest0-21swapper/207:41:572
702887991713,3cyclictest0-21swapper/111:47:071
702887991711,5cyclictest0-21swapper/111:36:581
702887991711,4cyclictest840345-21grep11:27:071
70288799171,13cyclictest771065-21/usr/sbin/munin09:47:091
70288699178,6cyclictest788012-21aten_r2power_vo10:11:590
70288699175,4cyclictest743408-21ps09:12:390
70288699174,9cyclictest738213-21ls08:57:090
70288699173,10cyclictest721817-21munin-run08:07:090
70288699172,13cyclictest876952-21fschecks_time12:16:580
702886991713,1cyclictest0-21swapper/009:46:550
70288999164,8cyclictest0-21swapper/311:17:073
702888991612,3cyclictest795944-21ntp_kernel_err10:22:092
70288799168,5cyclictest0-21swapper/111:31:531
70288799161,5cyclictest702846-21munin-run07:12:081
702887991613,3cyclictest711111-21idleruntime-cro07:37:091
70288699169,4cyclictest0-21swapper/008:31:570
70288699167,2cyclictest891585-21aten_r2power_en12:36:520
70288699162,12cyclictest829740-21ssh11:12:020
702886991610,4cyclictest0-21swapper/007:26:550
70288699160,9cyclictest896686-21grep12:42:040
70288699160,7cyclictest0-21swapper/009:26:530
112299160,3rtkit-daemon1121-21rtkit-daemon08:07:100
112299160,1rtkit-daemon0-21swapper/008:12:220
70288999153,8cyclictest0-21swapper/310:01:563
70288899159,4cyclictest810076-21grep10:42:162
70288899156,7cyclictest0-21swapper/210:17:132
70288899155,6cyclictest826433-21munin-run11:07:092
70288899154,9cyclictest726179-21fschecks_time08:22:032
70288899152,9cyclictest719565-21fschecks_time08:01:562
70288899152,7cyclictest876658-21aten_r2power_en12:16:532
702888991512,2cyclictest1002-21mta-sts-daemon11:02:082
702888991511,3cyclictest896275-21fschecks_time12:41:592
702888991511,3cyclictest889496-21unixbench_multi12:32:122
702888991511,3cyclictest832850-21fschecks_count11:16:592
70288799159,4cyclictest0-21swapper/112:27:041
70288799159,4cyclictest0-21swapper/112:21:581
70288799154,9cyclictest818498-21basename10:56:571
70288799152,9cyclictest815041-21tail10:51:531
70288799151,9cyclictest788808-21ssh10:12:091
702887991512,2cyclictest850494-21needreboot11:42:021
702887991512,2cyclictest758261-21grep09:32:001
70288799150,12cyclictest704755-21cut07:16:591
70288799150,10cyclictest778432-21grep09:57:101
70288699155,2cyclictest710329-21cat07:32:090
70288699153,10cyclictest728394-21wc08:27:090
70288699151,1cyclictest758317-21fschecks_time09:32:000
70288699150,11cyclictest704786-21fschecks_time07:16:590
112299150,1rtkit-daemon0-21swapper/207:27:482
70288999143,6cyclictest0-21swapper/311:42:093
70288999140,7cyclictest0-21swapper/312:12:013
70288899149,3cyclictest0-21swapper/210:37:082
70288899148,4cyclictest718360-21latency_hist07:57:082
70288899146,2cyclictest11050irq/107-eth%d10:01:482
70288899144,7cyclictest0-21swapper/209:56:502
70288899143,8cyclictest829347-21/usr/sbin/munin11:11:582
70288899143,7cyclictest0-21swapper/207:12:082
70288899142,9cyclictest774471-21/usr/sbin/munin09:52:092
70288899142,8cyclictest0-21swapper/210:07:022
70288899142,7cyclictest788810-21/usr/sbin/munin10:12:092
702888991412,1cyclictest0-21swapper/208:07:022
70288899141,11cyclictest868879-21fschecks_count12:06:582
70288899141,11cyclictest853931-21/usr/sbin/munin11:47:092
70288899141,10cyclictest742283-21head09:11:522
70288799149,3cyclictest820059-21unixbench_multi10:57:161
70288799148,4cyclictest712529-21unixbench_multi07:37:271
70288799146,4cyclictest724008-21/usr/sbin/munin08:12:211
70288799145,5cyclictest784465-21/usr/sbin/munin10:07:131
70288799143,9cyclictest873339-21/usr/sbin/munin12:12:031
70288799141,9cyclictest778679-21/usr/sbin/munin09:57:111
702887991411,2cyclictest742643-21gltestperf09:11:581
702887991410,3cyclictest718363-21munin-run07:57:081
70288699142,8cyclictest0-21swapper/008:37:030
70288699142,7cyclictest716806-21latency_hist07:52:090
70288699141,9cyclictest858649-21/usr/sbin/munin11:52:120
702886991410,3cyclictest0-21swapper/007:37:130
112299140,1rtkit-daemon0-21swapper/207:18:482
70288999134,5cyclictest0-21swapper/309:52:033
70288999134,4cyclictest0-21swapper/310:57:153
70288999134,4cyclictest0-21swapper/310:57:003
70288999132,6cyclictest0-21swapper/311:52:093
70288999131,8cyclictest0-21swapper/311:26:593
70288899137,4cyclictest732731-21fschecks_time08:42:032
70288899135,6cyclictest0-21swapper/210:27:142
70288899131,9cyclictest2008528-21snmpd12:32:042
70288899131,6cyclictest754044-21/usr/sbin/munin09:27:012
702888991311,2cyclictest1001-21mta-sts-daemon09:07:042
70288799139,3cyclictest705968-21unixbench_multi07:17:161
70288799139,3cyclictest0-21swapper/108:47:091
70288799139,2cyclictest803256-21unixbench_multi10:32:131
70288799138,4cyclictest762962-21cron09:37:091
70288799138,4cyclictest0-21swapper/112:41:571
70288799132,8cyclictest728804-21/usr/sbin/munin08:27:141
70288799132,8cyclictest727295-21/usr/sbin/munin08:22:191
70288799132,6cyclictest736646-21grep08:52:101
70288799131,8cyclictest771444-21/usr/sbin/munin09:47:121
70288799131,8cyclictest0-21swapper/111:52:101
70288799131,5cyclictest11050irq/107-eth%d07:57:091
702887991311,1cyclictest0-21swapper/112:32:131
702887991310,2cyclictest874245-21unixbench_multi12:12:131
702887991310,2cyclictest714704-21gltestperf07:47:001
702887991310,2cyclictest0-21swapper/111:07:071
702887991310,2cyclictest0-21swapper/108:37:091
70288799130,1cyclictest11050irq/107-eth%d10:46:561
70288699139,3cyclictest1000-21mta-sts-daemon07:17:160
70288699133,9cyclictest734012-21/usr/sbin/munin08:46:570
70288699133,9cyclictest714204-21/usr/sbin/munin07:42:130
70288699133,8cyclictest732024-21/usr/sbin/munin08:37:140
70288699133,8cyclictest710534-21/usr/sbin/munin07:32:130
70288699132,7cyclictest742521-21fschecks_count09:11:570
70288699131,8cyclictest0-21swapper/008:17:130
70288699130,10cyclictest735933-21cut08:51:590
70288999124,4cyclictest0-21swapper/310:22:083
70288999123,5cyclictest0-21swapper/311:07:033
70288999123,5cyclictest0-21swapper/310:27:153
70288999122,7cyclictest0-21swapper/310:47:073
70288999121,8cyclictest0-21swapper/308:22:093
70288999121,5cyclictest0-21swapper/312:27:073
70288999121,5cyclictest0-21swapper/311:55:133
70288899128,2cyclictest0-21swapper/209:17:082
70288899127,1cyclictest11050irq/107-eth%d09:33:512
70288899126,5cyclictest0-21swapper/211:52:102
70288899125,4cyclictest739934-21/usr/sbin/munin09:02:082
70288899123,6cyclictest767394-21ssh09:42:102
70288899122,8cyclictest873455-21awk12:12:052
70288899122,8cyclictest846764-21grep11:36:572
70288899122,6cyclictest714590-21fschecks_count07:46:592
702888991210,1cyclictest0-21swapper/208:32:022
702888991210,1cyclictest0-21swapper/208:12:172
70288899120,4cyclictest880945-21grep12:21:572
70288799129,2cyclictest738875-21unixbench_singl08:57:221
70288799127,3cyclictest754126-21aten_r2power_en09:26:541
70288799123,5cyclictest738214-21sort08:57:091
70288799121,9cyclictest885937-21sed12:27:121
70288799121,3cyclictest724730-21tune2fs08:17:171
70288799120,6cyclictest11050irq/107-eth%d09:17:001
70288699120,7cyclictest0-21swapper/008:57:220
70288999114,5cyclictest0-21swapper/311:37:053
70288999113,5cyclictest0-21swapper/312:17:113
70288999113,5cyclictest0-21swapper/310:12:033
70288999113,4cyclictest0-21swapper/309:32:083
70288999113,4cyclictest0-21swapper/307:52:223
70288999112,6cyclictest0-21swapper/312:37:063
70288999112,5cyclictest0-21swapper/309:52:103
70288999112,5cyclictest0-21swapper/309:42:093
70288999112,5cyclictest0-21swapper/309:12:403
70288999112,5cyclictest0-21swapper/309:02:133
70288999112,4cyclictest0-21swapper/312:39:513
70288999112,4cyclictest0-21swapper/310:03:153
70288999112,4cyclictest0-21swapper/308:57:053
70288999111,6cyclictest0-21swapper/310:37:213
70288999111,5cyclictest0-21swapper/309:32:163
70288999111,5cyclictest0-21swapper/309:21:583
70288999111,4cyclictest0-21swapper/307:37:153
70288999110,6cyclictest0-21swapper/312:01:593
70288899119,1cyclictest0-21swapper/208:32:092
70288899118,2cyclictest734299-21fschecks_count08:46:572
70288899114,4cyclictest0-21swapper/208:07:112
70288899112,6cyclictest0-21swapper/210:07:112
70288899112,5cyclictest704750-21fschecks_count07:16:592
70288899111,2cyclictest0-21swapper/207:26:592
70288799117,2cyclictest0-21swapper/109:21:541
70288799114,5cyclictest0-21swapper/107:31:571
70288799113,5cyclictest708051-21/usr/sbin/munin07:26:591
70288799111,8cyclictest721216-21tune2fs08:06:581
70288799110,9cyclictest722196-21cat08:07:141
112299110,1rtkit-daemon0-21swapper/007:09:240
70288999104,4cyclictest0-21swapper/311:47:093
70288999103,5cyclictest0-21swapper/311:11:553
70288999103,4cyclictest0-21swapper/311:32:073
70288999102,6cyclictest0-21swapper/309:47:003
70288999102,5cyclictest0-21swapper/308:42:083
70288999102,4cyclictest0-21swapper/309:07:103
70288999102,4cyclictest0-21swapper/308:57:093
70288999102,4cyclictest0-21swapper/307:42:103
70288999102,4cyclictest0-21swapper/307:32:133
70288999101,5cyclictest0-21swapper/312:17:043
70288999101,4cyclictest0-21swapper/312:27:553
70288999100,6cyclictest0-21swapper/308:52:013
70288999100,5cyclictest0-21swapper/307:52:033
70288899101,6cyclictest0-21swapper/208:47:132
70288799107,2cyclictest0-21swapper/108:37:151
70288799101,8cyclictest740577-21/usr/sbin/munin09:06:561
7028899994,4cyclictest0-21swapper/307:12:103
7028899993,4cyclictest0-21swapper/307:27:103
7028899993,3cyclictest0-21swapper/308:36:563
7028899992,4cyclictest0-21swapper/312:06:563
7028899992,4cyclictest0-21swapper/310:32:123
7028899992,4cyclictest0-21swapper/310:12:193
7028899992,4cyclictest0-21swapper/308:22:093
7028899992,4cyclictest0-21swapper/308:06:563
7028899992,3cyclictest0-21swapper/308:12:113
7028899991,4cyclictest0-21swapper/307:22:053
7028899991,3cyclictest0-21swapper/308:07:113
7028899990,5cyclictest0-21swapper/308:01:533
7028889991,4cyclictest711128-21/usr/sbin/munin07:37:092
7028899985,2cyclictest0-21swapper/308:27:173
7028899983,3cyclictest0-21swapper/310:22:113
7028899983,3cyclictest0-21swapper/309:27:053
7028899983,3cyclictest0-21swapper/308:42:153
7028899981,4cyclictest0-21swapper/307:27:093
7028899931,1cyclictest0-21swapper/307:12:083
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional