You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-12-09 - 09:37

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #0, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack0slot7s.osadl.org (updated Sat Dec 09, 2023 00:43:43)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3565747211871,19sleep20-21swapper/219:06:112
3565788211572,36sleep10-21swapper/119:06:261
3565655210661,19sleep00-21swapper/019:05:360
356411629973,20sleep30-21swapper/319:05:123
3566522998810,46cyclictest0-21swapper/121:02:501
356651799652,0cyclictest14-21ksoftirqd/023:33:590
356651799650,1cyclictest171rcuc/023:43:590
3566534996463,1cyclictest3563155-21kworker/3:020:45:593
3566534996461,2cyclictest8664-21gnome-shell00:19:583
356653499640,64cyclictest0-21swapper/322:59:593
3566522996461,2cyclictest8664-21gnome-shell20:57:581
356651799640,0cyclictest0-21swapper/022:41:590
3566534996363,0cyclictest3738613-21kworker/3:023:32:593
3566534996363,0cyclictest3665948-21kworker/3:322:03:343
3566534996363,0cyclictest3643234-21kworker/3:121:46:003
3566534996362,1cyclictest3665380-21Classif~09:47:323
356653499630,63cyclictest0-21swapper/320:50:583
356653499630,63cyclictest0-21swapper/319:32:593
356653499630,0cyclictest0-21swapper/322:40:593
3566530996360,2cyclictest8664-21gnome-shell21:42:582
3566517996363,0cyclictest0-21swapper/023:35:590
3566517996362,1cyclictest3634036-21kworker/0:221:22:590
3566517996362,1cyclictest3634036-21kworker/0:221:18:590
3566517996360,2cyclictest8664-21gnome-shell21:40:580
356651799630,63cyclictest0-21swapper/023:25:590
356651799630,63cyclictest0-21swapper/022:38:000
3566534996262,0cyclictest3797011-21kworker/3:200:27:593
3566534996262,0cyclictest3563155-21kworker/3:020:32:593
3566534996262,0cyclictest3563155-21kworker/3:020:22:583
3566534996262,0cyclictest3563155-21kworker/3:020:18:593
356653499620,62cyclictest0-21swapper/322:10:283
356653499620,62cyclictest0-21swapper/321:17:593
356653499620,62cyclictest0-21swapper/319:29:593
356653499620,62cyclictest0-21swapper/300:00:593
356653499620,0cyclictest0-21swapper/323:03:333
356653499620,0cyclictest0-21swapper/321:57:593
3566530996259,2cyclictest8664-21gnome-shell23:48:582
356653099620,61cyclictest0-21swapper/220:44:592
356653099620,61cyclictest0-21swapper/220:16:592
3566522996259,2cyclictest8664-21gnome-shell20:34:591
3566517996261,1cyclictest3621929-21kworker/0:021:03:590
3566517996261,1cyclictest3592000-21kworker/0:120:01:590
356651799620,62cyclictest0-21swapper/023:00:590
3566534996161,0cyclictest3797011-21kworker/3:200:30:593
3566534996161,0cyclictest3563155-21kworker/3:020:28:593
356653499610,61cyclictest0-21swapper/320:44:593
356653499610,61cyclictest0-21swapper/319:46:593
356653499610,61cyclictest0-21swapper/319:40:593
356653499610,0cyclictest0-21swapper/323:59:593
3566530996158,2cyclictest8664-21gnome-shell22:28:582
3566522996160,1cyclictest3553849-21kworker/1:219:30:591
3566522996158,2cyclictest785527-21firefox22:03:331
3566517996161,0cyclictest3586480-21kworker/0:219:53:580
3566517996161,0cyclictest1067-21snmpd00:11:190
3566517996160,1cyclictest3607078-21kworker/0:120:53:590
3566517996160,1cyclictest3607078-21kworker/0:120:33:330
3566517996160,1cyclictest3586480-21kworker/0:219:49:590
3566517996160,1cyclictest3566254-21kworker/0:019:11:590
356651799610,61cyclictest0-21swapper/023:21:590
356651799610,61cyclictest0-21swapper/021:40:000
356651799610,0cyclictest0-21swapper/022:49:590
3566534996060,0cyclictest3643234-21kworker/3:121:42:593
3566534996059,1cyclictest3643234-21kworker/3:121:30:003
356653499600,60cyclictest0-21swapper/322:06:593
356653499600,60cyclictest0-21swapper/320:58:593
3566517996060,0cyclictest3573947-21kworker/0:019:26:590
3566517996060,0cyclictest3569811-21kworker/0:119:15:590
3566517996059,1cyclictest0-21swapper/020:24:580
356651799600,0cyclictest0-21swapper/020:47:590
3566534995959,0cyclictest3563155-21kworker/3:020:10:593
3566534995957,1cyclictest8664-21gnome-shell22:54:583
356653499590,59cyclictest0-21swapper/323:25:003
356653499590,59cyclictest0-21swapper/321:00:593
356653499590,0cyclictest0-21swapper/322:36:593
356653499590,0cyclictest0-21swapper/321:11:593
3566530995956,2cyclictest8664-21gnome-shell23:38:592
3566517995959,0cyclictest3576774-21kworker/0:119:43:590
3566517995959,0cyclictest3576774-21kworker/0:119:36:580
3566517995958,1cyclictest3629286-21kworker/0:021:11:580
3566517995957,2cyclictest8664-21gnome-shell00:01:580
356651799590,59cyclictest0-21swapper/023:18:590
356651799590,59cyclictest0-21swapper/022:55:000
356651799590,59cyclictest0-21swapper/020:38:590
356651799590,59cyclictest0-21swapper/020:25:590
356653499580,58cyclictest0-21swapper/322:46:003
356653499580,0cyclictest0-21swapper/323:13:593
3566530995857,1cyclictest0-21swapper/221:45:252
3566530995855,2cyclictest8664-21gnome-shell21:31:592
3566530995855,2cyclictest8664-21gnome-shell00:31:582
3566517995858,0cyclictest3576774-21kworker/0:119:33:590
3566517995858,0cyclictest3573947-21kworker/0:019:21:580
356653499570,57cyclictest0-21swapper/321:05:583
356653499570,1cyclictest40-21ksoftirqd/300:22:593
3566530995755,1cyclictest8664-21gnome-shell22:19:592
3566530995754,2cyclictest8664-21gnome-shell23:24:592
356653099570,56cyclictest0-21swapper/221:05:582
356653099570,56cyclictest0-21swapper/219:25:312
3566522995756,1cyclictest3658004-21kworker/1:222:09:521
356652299570,1cyclictest0-21swapper/100:34:591
3566517995757,0cyclictest3621929-21kworker/0:020:59:580
3566517995756,1cyclictest3664838-21sensors21:50:350
3566517995756,1cyclictest3592000-21kworker/0:119:59:590
356651799570,57cyclictest0-21swapper/000:09:590
356651799570,0cyclictest0-21swapper/023:54:590
356651799570,0cyclictest0-21swapper/021:33:000
3566534995656,0cyclictest3643234-21kworker/3:121:36:593
356653499560,0cyclictest0-21swapper/319:38:593
3566530995655,1cyclictest3781560-21sensors00:00:312
3566530995655,1cyclictest0-21swapper/222:34:582
3566530995653,2cyclictest8664-21gnome-shell00:27:582
3566522995655,1cyclictest3720129-21kworker/1:123:00:231
3566522995655,1cyclictest1067-21snmpd21:19:231
356652299560,56cyclictest0-21swapper/123:44:581
3566517995655,1cyclictest3624608-21kworker/0:121:08:590
356651799560,56cyclictest0-21swapper/020:13:590
356651799560,56cyclictest0-21swapper/020:07:580
3566534995554,1cyclictest0-21swapper/319:15:263
3566517995555,0cyclictest0-21swapper/022:33:590
3566517995554,1cyclictest3654105-21kworker/0:121:48:340
356651799550,55cyclictest0-21swapper/022:14:590
3566534995453,1cyclictest0-21swapper/319:20:273
3566530995451,2cyclictest8664-21gnome-shell23:11:582
3566522995453,1cyclictest3633717-21kworker/1:121:45:181
3566522995451,2cyclictest8664-21gnome-shell20:45:591
3566517995451,2cyclictest8664-21gnome-shell22:25:580
3566530995352,1cyclictest0-21swapper/222:50:282
3566530995352,1cyclictest0-21swapper/221:50:342
3566530995350,2cyclictest8664-21gnome-shell22:55:582
3566522995352,1cyclictest3771095-21kworker/1:100:12:341
3566522995352,1cyclictest3705706-21kworker/1:022:52:221
3566522995352,1cyclictest3700715-21sensors22:30:261
3566522995352,1cyclictest0-21swapper/123:36:581
3566530995252,0cyclictest0-21swapper/223:33:322
3566522995251,1cyclictest3603611-21sensors20:20:281
3566522995251,1cyclictest1067-21snmpd00:26:231
3566517995250,2cyclictest3627273-21diskmemload21:59:290
3566530995148,2cyclictest8664-21gnome-shell22:20:592
3566522995150,1cyclictest3786106-21sensors00:05:351
3566522995150,1cyclictest3638855-21kworker/1:221:25:391
3566534995049,1cyclictest8664-21gnome-shell23:54:583
3566530995049,1cyclictest0-21swapper/219:45:262
3566522995049,1cyclictest3792437-21kworker/1:000:17:421
3566522995049,1cyclictest3743901-21kworker/1:223:28:321
3566522995049,1cyclictest3628855-21sensors21:10:261
3566517995049,1cyclictest0-21swapper/022:03:580
3566534994948,1cyclictest0-21swapper/323:25:303
3566530994948,1cyclictest0-21swapper/219:40:262
3566530994948,1cyclictest0-21swapper/200:23:582
3566522994948,1cyclictest3669278-21sensors21:55:281
3566522994948,1cyclictest3658004-21kworker/1:222:28:581
3566534994846,2cyclictest0-21swapper/322:20:273
3566530994845,2cyclictest8664-21gnome-shell19:13:592
3566522994847,1cyclictest3658004-21kworker/1:222:17:321
3566522994847,1cyclictest3612238-21kworker/1:021:09:261
3566522994847,1cyclictest3553849-21kworker/1:220:06:481
3566522994847,1cyclictest0-21swapper/123:07:591
3566517994847,1cyclictest3795077-21sensors00:15:330
3566534994746,1cyclictest0-21swapper/300:10:343
3566530994746,1cyclictest0-21swapper/219:16:592
3566522994746,1cyclictest3751215-21kworker/1:123:34:411
3566522994746,1cyclictest3745633-21sensors23:20:311
3566522994746,1cyclictest3612238-21kworker/1:020:44:221
3566522994746,1cyclictest3567843-21sensors19:10:261
3566517994746,1cyclictest3799555-21sensors00:20:320
3566530994645,1cyclictest3709710-21sensors22:40:282
3566530994643,2cyclictest8664-21gnome-shell21:36:582
3566530994643,2cyclictest8664-21gnome-shell21:26:582
3566522994645,1cyclictest3553849-21kworker/1:220:37:521
3566522994645,1cyclictest3553849-21kworker/1:220:12:271
3566522994645,1cyclictest3553849-21kworker/1:219:45:291
3566534994544,1cyclictest0-21swapper/323:46:143
3566530994544,1cyclictest0-21swapper/223:00:262
3566530994542,2cyclictest8664-21gnome-shell00:16:582
3566522994544,1cyclictest3771095-21kworker/1:100:20:051
3566522994544,1cyclictest3658004-21kworker/1:222:39:241
3566534994442,2cyclictest8664-21gnome-shell20:01:593
3566530994441,2cyclictest8664-21gnome-shell23:52:592
3566530994441,2cyclictest8664-21gnome-shell23:05:592
3566522994444,0cyclictest3658004-21kworker/1:222:13:471
3566522994443,1cyclictest3738952-21kworker/1:023:19:191
3566522994443,1cyclictest3705706-21kworker/1:022:45:211
3566522994443,1cyclictest3633717-21kworker/1:121:41:011
3566522994443,1cyclictest3588542-21sensors19:50:261
3566522994443,1cyclictest1067-21snmpd23:56:161
3566522994442,1cyclictest3553849-21kworker/1:219:25:211
3566517994442,2cyclictest8664-21gnome-shell23:59:580
3566530994342,1cyclictest3596079-21sensors20:05:262
3566530994342,1cyclictest0-21swapper/200:09:582
3566530994340,2cyclictest8664-21gnome-shell20:02:592
3566522994342,1cyclictest3756635-21kworker/1:023:48:201
3566522994342,1cyclictest3658004-21kworker/1:222:24:331
3566522994342,1cyclictest3633717-21kworker/1:121:32:501
3566522994342,1cyclictest0-21swapper/122:57:581
3566522994341,1cyclictest3640717-21rm21:24:581
3566517994342,1cyclictest0-21swapper/023:45:280
3566530994241,1cyclictest0-21swapper/220:25:292
3566522994241,1cyclictest3771095-21kworker/1:123:53:171
3566517994240,1cyclictest3688999-21ssh22:17:580
3566534994140,1cyclictest0-21swapper/323:41:583
3566534994140,1cyclictest0-21swapper/300:06:193
3566522994141,0cyclictest3651930-21ssh21:35:591
3566522994140,1cyclictest3553849-21kworker/1:220:15:211
3566522994040,0cyclictest3813619-21kworker/1:000:39:321
3566517994037,2cyclictest8664-21gnome-shell00:33:330
3566522993938,1cyclictest0-21swapper/100:00:581
3566534993736,1cyclictest0-21swapper/320:06:593
3566530993736,1cyclictest0-21swapper/200:38:592
3566522993736,1cyclictest3720129-21kworker/1:123:13:311
3566522993736,1cyclictest3705706-21kworker/1:022:40:351
3566522993736,1cyclictest0-21swapper/120:03:591
3566522993635,1cyclictest3612238-21kworker/1:020:51:311
3566522993535,0cyclictest3553849-21kworker/1:219:56:551
3566522993534,1cyclictest3665614-21kworker/1:021:51:571
3566517993534,1cyclictest0-21swapper/020:41:580
3566522993433,1cyclictest3553849-21kworker/1:220:26:161
3566522993433,1cyclictest3553849-21kworker/1:219:40:421
3566522993433,1cyclictest3553849-21kworker/1:219:35:441
3566522993433,1cyclictest3553849-21kworker/1:219:20:231
3566534993332,1cyclictest3759070-21ssh23:35:293
3566534993332,1cyclictest0-21swapper/321:33:593
3566530993330,2cyclictest8664-21gnome-shell20:20:582
3566530993330,2cyclictest8664-21gnome-shell19:30:592
3566522993333,0cyclictest3553849-21kworker/1:219:16:081
3566530993230,1cyclictest8664-21gnome-shell21:59:582
3566530993211,21cyclictest0-21swapper/220:13:132
3566534993130,1cyclictest1067-21snmpd23:09:443
3566530993029,1cyclictest3618651-21sensors20:50:282
3566530993027,2cyclictest8664-21gnome-shell19:21:592
3566517993027,2cyclictest8664-21gnome-shell21:29:580
3566530992928,1cyclictest0-21swapper/222:00:302
3566534992826,2cyclictest8664-21gnome-shell20:36:583
3566517992827,1cyclictest3813044-21sensors00:35:330
3566534992726,1cyclictest0-21swapper/321:23:583
3566534992726,1cyclictest0-21swapper/319:56:593
3566534992726,1cyclictest0-21swapper/319:10:263
356653099270,26cyclictest0-21swapper/222:11:012
3566530992623,2cyclictest785527-21firefox21:18:332
3566534992423,1cyclictest0-21swapper/322:15:593
156499240,2ntpd40-21ksoftirqd/322:27:483
3566530992221,1cyclictest0-21swapper/223:25:302
356653099220,22cyclictest0-21swapper/222:45:122
3566517991918,1cyclictest8664-21gnome-shell20:17:590
3566530991817,1cyclictest0-21swapper/220:32:592
356653099180,3cyclictest0-21swapper/219:55:402
356653099180,17cyclictest0-21swapper/219:50:392
356653499172,12cyclictest0-21swapper/322:31:103
356653099170,16cyclictest0-21swapper/221:03:452
356653499160,1cyclictest0-21swapper/319:50:223
356653099166,9cyclictest3678760-21ssh22:05:432
356653099160,15cyclictest0-21swapper/223:15:212
356653099160,15cyclictest0-21swapper/221:10:232
3566517991615,1cyclictest8664-21gnome-shell22:07:590
356651799160,7cyclictest151rcu_preempt23:09:190
356651799160,16cyclictest0-21swapper/023:11:370
356651799160,16cyclictest0-21swapper/000:27:450
356653499150,7cyclictest0-21swapper/300:37:283
356653499150,15cyclictest0-21swapper/323:17:403
3566530991514,1cyclictest0-21swapper/220:55:312
3566530991411,2cyclictest1067-21snmpd23:57:472
3566530991312,1cyclictest0-21swapper/220:49:592
3566530991310,2cyclictest1067-21snmpd23:41:082
356653099130,13cyclictest0-21swapper/219:36:302
3566530991210,1cyclictest1067-21snmpd20:37:252
356653099120,12cyclictest0-21swapper/200:10:332
356651799119,2cyclictest1067-21snmpd22:23:000
356651799110,1cyclictest151rcu_preempt22:57:090
35665309990,8cyclictest3705026-21ntpq22:35:262
35665309980,3cyclictest10237-21gmain21:20:252
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional