H13-723_V2.0 HCIP-Big Data Developer V2.0 Questions and Answers

True

False

Source

channel

sink

topic

HBase

Spark

MapReduce

Streaming

to emit

execute

open

nextTuple

taildir

Log4j

JMS

Thrift

hdfs fsck/test.txt-files

hdfs fsck/test.txt-locations

hdfs fsck/test.txt-blocks

hdfs fsck/test.txt-list-corruptfileblocks

read only

partition

fault tolerance

efficient

1

2

3

4

Streaming data monitoring

Real-time visit statistics of the website

Offline log analysis

Traffic flow analysis

Attribute values with high access weight are placed inRowKeyFront

Attribute values with high access weight are placed inRowkeysecond half

Attribute values with good dispersion are placed inRowkeyfirst half

Attribute values with good dispersion are placed inRowkeysecond half

Nimbus

Supervisor

Broker

quorumpeer

HBaseIt can store massive data and support dynamic expansion, which can fulfill the storage requirements of logistics and sales data.

HbaseSupport colleges and universities to read immediately, and can complete real-time analysis and command of the logistics situation through reasonable design.

Logistics data is very sparse,HBaseCan handle sparse data efficiently.

HBaseIt can be built on ordinary commercial servers, and the construction cost is relatively low.

1

2

3

4

True

False

usehashstructure, and a table uses ahash key, a row in the table records forhash keyone offield.

usehashstructure, each row record of each table uses onehash key,hash keyoffieldThe fields of the corresponding table records,

and designKEYEach table adds a different prefix to distinguish it.

usestringstructure, each field of each row record of each table uses oneKEY.

usestringstructure, each row record of each table uses oneKEY,valueAll fields recorded for a row in a table? ? back

value of .

Get data and convert raw data into data objects that you process yourself

Cache data and save data in memory or files according to different reliability policies

Output data to the destination, support multiple output protocols

Split the data and send the data to different destinations according to the characteristics of the data

ConsumerMainly for data consumption

ConsumerNeed to specify when consuming dataTopic

multipleConsumerconfigure the samegroup.idwhen theseConsumerConsumed data will not be duplicated

newConsumerAPIConsumption data does not need to be specifiedZooKeeperaddress

priority from the nearestDataNodeDownload data.

file data fromDataNodeback toNameNode, then fromNameNodeDown to the client.

If the client and the connectedDataNodeIf there is a failure in reading, then the client will give up the applause node and connect the node where other replicas are located.

Supports multiple clients fromDataNoderead the same file data.

Easy to program

Good scalability

Real-time computing

High fault tolerance

32MB

64MB

128MB

256MB

Produceris a message producer

ProducerProduction data needs to be specifiedTopic

Can play multiple at the same timeProducerprocess to the sameTopicsend data

ProducerNeed to connect first when producing dataZooKeeper, and then connectBroker

eachDataNodemaximum storage1copy.

Support multiple users to write to the same file at the same time.

The first copy of the data block is placed preferentially on the node where the client writing the data block is located.

Copied file blocks all exist on the same rack by default.

yarm.scheduler.capacity.rot.QueueA. user-limit-factor

yam.scheduler.capacity.root.QueueA. minimum-userlimit-percent

yarm.scheduler.capacity.root.QueueA. capacity yarm.scheduler.capacity.rot.QueueA

stream processing

high performance

Scalable

High fault tolerance

128M

100M

64M

50M

Create an input stream

Create output stream

Business action statements (such asSELECT,INSERT,JIONWait)

Apply commit statement

Both are available externallySQLor classSQLability

Both can run onMapReduceon the computational framework

Both are available via table fields andHBaseAccess by field mappingHBasedata on

Both can run onSparkon the computational framework

RequirePythonversion no lower than2.6.6,not higher than2.7.0

Client must havesetuptools, and the version is not lower than5.0

hive_python_clientscript provides direct executionSQLfunctions, such ashive_python_client'show tables'

PythonSecondary development does not support secure clusters

Name+Phone number

date+Phone number

Phone number+date

Phone number+Name

True

False

HDFS

HBase

Spark

YARN(streaming)

In a network isolation environment,ZooKeeperofIPCan be configured as a businessIP, can also be configured to manageIP.

hiveUnlike traditional databases, soJDB, CThe established connection does not need to be closed.

In a secure cluster environment, establish andHiveBefore connecting, you need to use unified authentication to log in.

useJDB, CsubmitSQL, you canSQLPut a semicolon after the statement";"

True

False

Give this user accountglobelread permission

Give this user accountNamespace1read and write permissions

Give this user accountTable1andTable2read and write permissions

Give wave user accountNamespace1andNamespace2read and write permissions,

rval counts = textFile.map(line => line.split("")).map(word =>(word,

1)).reduceByKey(+)

val counts = textFile.flatMap(line => line.split(")).map(word =>(word,

1)).reduceByKey(+)

vrval counts = textFie.map(line => line.split(")).map(word =>(word,

1)).groupByKey( )

vrval counts = textFile.flatMap(line => line.split("")).map(word =>(word,

1)).groupByKey( )

Shuffle Grouping

Field Grouping

Laal Gg

Direct Grouping

ZooKeeper

HDFS

HMaster

RegionServer

existSolrCreate an index and save the data, and return all the data during full-text search.

existHBasestore data on theHBaseThe filtering characteristics of , satisfy fuzzy matching query.

When storing data, inSolrindex on theHBaseStore complete data? ?when, throughSolrFull-text search to obtain and record

record key information, through the key information inHBasefor the full record.

lob

Context

FileSystem

Configuration

True

False

SolrUser group users can create configuration sets and createCollectionwhen specifying the configuration set

SolrUsers of the user group can createCollection

Collectioncreator, theCollectionroles with read and write permissions andSolr adminrole can beCollectionEnter

row update

onlyCollectioncreator andSolr adminRoles can be deletedCollection

Kafka-topics.sh–describe

Kafka-topics.sh–list

kafka-topics.sh–alter

kafka-topics.sh–create

read only

partition

fault tolerance

efficient

HDFSDepend onNameNode,DataNode,Clientcomposition.

HDFSprepareNameNodeThe metadata on theNameNodeSync the past directly.

HDFSThe first copy of the data can be stored by using the rack node close to the client.

HDFSIt is suitable for the scenario of writing once and reading many times.

mouthJDB, Cinterface

mouthODB, Cinterface

mouthPythoninterface

mouthRubyinterface

Active and standbyNameNodeThe disk space where the metadata is located is insufficient.

The number of missing blocks exceeds the read value.

Lost copies exceed read value.

The corrupted copy exceeds the threshold.

True

False

mergemapThe result of the stage has the samekeyvalue key-value pair

put allmapThe results of the stages are merged to get the final result

rightmapThe results of the stages are sorted and merged

Split the input data into individualsplit, and willsplitfurther split intoyes, then asmapletter input of numbers

filter (condifionExpr: String): DataFrame

join (right: DataFrame, join Exprs: Column): DataFrame

intersect (other: Data Frame): Data Frame

dropDuplicates (): DataFrame

usehashstructure, and a table uses ahash key, a row in the table records forhash keyone offield.

usehashstructure, each row record of each table uses onehash key,hash keyoffieldThe fields of the corresponding table records,

and designKEYEach table adds a different prefix to distinguish it.

usestringstructure, each field of each row record of each table uses oneKEY.

usestringstructure, each row record of each table uses oneKEY,valueAll fields recorded for a row in a table? ?back value of .

JDB, Cinterface

ODB, Cinterface

Pythoninterface

Rubyinterface

CheckOozieofJava APIWhether the returned result is as expected

pass throughHueofworkflowDashboard to view program running results

pass throughHue's file browser to see ifHDFSThe specified directory produces the expected file

Oozieself-containedWebThe interface can also view the job execution results

NodeManager

container

ResourceManager

AppMaster

True

False

supportCSVandJSON

supportCSV,JSONandHTML

supportCSV,JSONandXML

in the application configuration filespark-defaults.confconfigure in

When submitting your application, pass—confmake settings

In the application code, passSparkContextofsetPropertymethod to set

In the application code, passSparkConfobject to set

ResourceManager

Contaioner

AppMaster

NodeManager

When the client initiates a scan request, it willscan cachingset too large

Initiate by client-specified methodFlushdo

RegionServerTotal memory exceeds threshold

RegionofMemStoreset over threshold

storage

Resource management

search

data transmission

True

False

5

10

20

30

True

False

easy to program

good scalability

real-time computing

High fault tolerance

True

False

Create an index on solr, save the data, and return all the data during full-text search

Store data on HBase, and satisfy fuzzy matching queries through HBase's filtering feature

When storing data, build an index on solr, and store complete data in HBase: query full text through solr

Retrieve the key information of the record, and obtain the complete record on HBase through the key information

OneTopologyis made up of a group ofSpoutcomponents andBoltcomponents passStream GroupingsA connected directed acyclic graph

(DAG)

Topologywill run until it is explicitlykill

Business logic is encapsulatedTopologymiddle

OneTopologyOnly one can be specified to startWorkerprocess

available fromHDFSdirectly into thehivesurface

available fromHiveServerThe local hard disk of the node is directly loaded into thehivesurface,

It can be directly loaded from the local hard disk of the node where the client is located.hivesurface

HiveThe data loading process does not parse the specific file content, mainly the process of file transfer

HBaseIt can store massive data and support dynamic expansion, which can fulfill the storage requirements of logistics and sales data.

HbaseIt supports efficient random reading, and can complete real-time analysis and command of the logistics situation through reasonable design.

Logistics data is very sparse,HBaseCan handle sparse data efficiently.

HBaseIt can be built on ordinary commercial servers, and the construction cost is relatively low.

True

False

Put

HTable

HBaseAdmin

Puttist

Memory Channel

File Channel

JDB, C Channel

HDFS Channel

If ZooKeeperIf there is an interruption in the process of synchronizing the message, after the failure is recovered, the transmission status before the failure can be adjusted according to the the state continues to synchronize, that is, support for resuming transmission from a breakpoint.

ZooKeeperUse a custom atomic message protocol to ensure the consistency of node data in the entire system.

ZooKeeperThe cluster is elected at startupLeaderRole.

LeaderAfter a node receives a data change request, it first writes to disk and then writes to memory.

emit (issue)

execute

open

nextTuple

Table Name

table names and columns

Table names and column families(family)

can be empty

True

False